perfSONAR User Q&A and Other Discussion

[Aaron Brown <>]

Hey Lixin,

> On Dec 22, 2014, at 1:16 PM, Lixin Liu 
> <>
>  wrote:
> 
> Hi Aaron,
> 
> As promised, I am reporting that we have successfully finished
> owamp database migration after running for 7 days.

Excellent. Sad it took that long...

> At this point, should I disable psb_to_esmond startup script
> (chkconfig psb_to_esmond off)?

I think it tries to disable itself after it finishes, but you could do that 
to make sure.

Cheers,
Aaron

> 
> Thank you very much.
> 
> Lixin.
> 
>> -----Original Message-----
>> From: 
>> 
>>  [
>> ]
>>  On Behalf Of Lixin Liu
>> Sent: December-17-14 9:15 AM
>> To: Aaron Brown
>> Cc: 
>> 
>> Subject: RE: [perfsonar-user] Update to 3.4 interrupted during DB 
>> migration
>> 
>> Hi Aaron,
>> 
>> I made the change. The migration is running for more than two hours and
>> has not been interrupted. I will let you know if this is successful.
>> 
>> Thank you very much.
>> 
>> Lixin.
>> 
>>> -----Original Message-----
>>> From: Aaron Brown 
>>> [mailto:]
>>> Sent: December-17-14 6:44 AM
>>> To: Lixin Liu
>>> Cc: 
>>> 
>>> Subject: Re: [perfsonar-user] Update to 3.4 interrupted during DB
>>> migration
>>> 
>>> Hey Lixin,
>>> 
>>> Could you edit /opt/perfsonar_ps/toolkit/scripts/psb_to_esmond.pl, and 
>>> try
>>> commenting out the lines like:
>>> 
>>> die "Error posting …”
>>> 
>>> And then re-run the tool. I don’t think the migration tool wasn’t made 
>>> to
>>> be
>>> restarted.
>>> 
>>> Cheers,
>>> Aaron
>>> 
>>>> On Dec 16, 2014, at 10:40 AM, Lixin Liu 
>>>> <>
>>>>  wrote:
>>>> 
>>>> Hi Aaron,
>>>> 
>>>> Yes, the OWAMP migration stopped and the script started processing
>>>> traceroute
>>>> records and stopped again with the same error.
>>>> 
>>>> Thanks,
>>>> 
>>>> Lixin.
>>>> 
>>>> On 2014-12-16, 7:06 AM, "Aaron Brown" 
>>>> <>
>>>>  wrote:
>>>> 
>>>>> Hi Lixin,
>>>>> 
>>>>> The Oconflict¹ error should just mean that it¹s attempting to 
>>>>> re-insert
>>>>> the data. Is that causing the process to stop or ?
>>>>> 
>>>>> Cheers,
>>>>> Aaron
>>>>> 
>>>>>> On Dec 16, 2014, at 12:01 AM, Lixin Liu 
>>>>>> <>
>>>>>>  wrote:
>>>>>> 
>>>>>> Hi Jason,
>>>>>> 
>>>>>> Rerunning psb_to_esmond script again, it went a bit further, but
>>>>>> failed
>>>>>> again:
>>>>>> 
>>>>>> 2014/12/15 20:46:09 (14952) INFO> psb_to_esmond.pl:286
>>>>>> main::convert_owamp
>>>>>> - Sending metadata....[START]
>>>>>> 2014/12/15 20:46:09 (14952) INFO> psb_to_esmond.pl:345
>>>>>> main::convert_owamp
>>>>>> - Sending metadata....[END]
>>>>>> 2014/12/15 20:46:16 (14952) INFO> psb_to_esmond.pl:272
>>>>>> main::convert_owamp
>>>>>> - Sending delay data for 1080253740.1241952063.1686456867....[START]
>>>>>> 2014/12/15 20:48:48 (14952) ERROR> psb_to_esmond.pl:185 main:: - 
>>>>>> Error
>>>>>> posting 1080253740.1241952063.1686456867409 CONFLICT
>>>>>> 
>>>>>> Any idea?
>>>>>> 
>>>>>> Thanks,
>>>>>> 
>>>>>> Lixin.
>>>>>> 
>>>>>> 
>>>>>> On 2014-12-15, 1:28 PM, "Jason Zurawski" 
>>>>>> <>
>>>>>>  wrote:
>>>>>> 
>>>>>>> Hey Lixin;
>>>>>>> 
>>>>>>> Our usual esmond expert is away for the holidays.  I don?t think
>>>>>>> there
>>>>>>> is
>>>>>>> any harm in re-running the script, but do note we haven?t tried 
>>>>>>> this
>>>>>>> failure scenario ourselves.
>>>>>>> 
>>>>>>> Sorry to not be very helpful;
>>>>>>> 
>>>>>>> -jason
>>>>>>> 
>>>>>>> On Dec 15, 2014, at 4:12 PM, Lixin Liu 
>>>>>>> <>
>>>>>>>  wrote:
>>>>>>> 
>>>>>>>> Hi,
>>>>>>>> 
>>>>>>>> For some unknown reason, the migration to new DB was interrupted
>>>>>>>> after a few hours. The log in /var/log/perfsonar/psb_to_esmond.log
>>>>>>>> shows:
>>>>>>>> 
>>>>>>>> 2014/12/14 03:29:29 (8021) INFO> psb_to_esmond.pl:286
>>>>>>>> main::convert_owamp -
>>>>>>>> Sending metadata....[START]
>>>>>>>> 2014/12/14 03:29:29 (8021) INFO> psb_to_esmond.pl:345
>>>>>>>> main::convert_owamp -
>>>>>>>> Sending metadata....[END]
>>>>>>>> 2014/12/14 03:30:01 (8021) INFO> psb_to_esmond.pl:272
>>>>>>>> main::convert_owamp -
>>>>>>>> Sending delay data for 1405144515.1241952063.1686456867....[START]
>>>>>>>> 2014/12/14 03:39:31 (8021) ERROR> psb_to_esmond.pl:185 main:: -
>>>>>>>> Error
>>>>>>>> posting 1405144515.1241952063.1686456867500 Server closed 
>>>>>>>> connection
>>>>>>>> without
>>>>>>>> sending any data back
>>>>>>>> 
>>>>>>>> 2014/12/14 03:39:31 (8021) INFO> psb_to_esmond.pl:565
>>>>>>>> main::convert_traceroute - Adding data from 2014-11-14
>>>>>>>> 2014/12/14 03:39:31 (8021) INFO> psb_to_esmond.pl:569
>>>>>>>> main::convert_traceroute - Finding test specs....[START]
>>>>>>>> 2014/12/14 03:39:31 (8021) INFO> psb_to_esmond.pl:583
>>>>>>>> main::convert_traceroute - Finding test specs....[END]
>>>>>>>> ...........
>>>>>>>> 
>>>>>>>> 2014/12/14 03:41:35 (8021) INFO> psb_to_esmond.pl:608
>>>>>>>> main::convert_traceroute - Sending traceroute data for
>>>>>>>> 3a00d5fea634d01080838bd3a7b148ff....[START]
>>>>>>>> 2014/12/14 03:41:36 (8021) ERROR> psb_to_esmond.pl:185 main:: -
>>>>>>>> Error
>>>>>>>> posting 3a00d5fea634d01080838bd3a7b148ff409 CONFLICT
>>>>>>>> 2014/12/14 03:41:36 (8021) INFO> psb_to_esmond.pl:742
>>>>>>>> main::save_state_file - Saving state file....[START]
>>>>>>>> 2014/12/14 03:41:36 (8021) INFO> psb_to_esmond.pl:750
>>>>>>>> main::save_state_file - Saving state file....[END]
>>>>>>>> 
>>>>>>>> 
>>>>>>>> Should I just rerun psb_to_esmond.pl script?
>>>>>>>> 
>>>>>>>> Thanks,
>>>>>>>> 
>>>>>>>> Lixin
>>>>>> 
>>>>>> 
>>>>> 
>>>> 
>>>> 
>