perfSONAR User Q&A and Other Discussion

[Lixin Liu <>]

Hi Aaron,

As promised, I am reporting that we have successfully finished
owamp database migration after running for 7 days.

At this point, should I disable psb_to_esmond startup script
(chkconfig psb_to_esmond off)?

Thank you very much.

Lixin.

> -----Original Message-----
> From: 
> 
>  [
> ]
>  On Behalf Of Lixin Liu
> Sent: December-17-14 9:15 AM
> To: Aaron Brown
> Cc: 
> 
> Subject: RE: [perfsonar-user] Update to 3.4 interrupted during DB 
> migration
>
> Hi Aaron,
>
> I made the change. The migration is running for more than two hours and
> has not been interrupted. I will let you know if this is successful.
>
> Thank you very much.
>
> Lixin.
>
> > -----Original Message-----
> > From: Aaron Brown 
> > [mailto:]
> > Sent: December-17-14 6:44 AM
> > To: Lixin Liu
> > Cc: 
> > 
> > Subject: Re: [perfsonar-user] Update to 3.4 interrupted during DB
> > migration
> >
> > Hey Lixin,
> >
> > Could you edit /opt/perfsonar_ps/toolkit/scripts/psb_to_esmond.pl, and 
> > try
> > commenting out the lines like:
> >
> > die "Error posting …”
> >
> > And then re-run the tool. I don’t think the migration tool wasn’t made 
> > to
> > be
> > restarted.
> >
> > Cheers,
> > Aaron
> >
> > > On Dec 16, 2014, at 10:40 AM, Lixin Liu 
> > > <>
> > >  wrote:
> > >
> > > Hi Aaron,
> > >
> > > Yes, the OWAMP migration stopped and the script started processing
> > > traceroute
> > > records and stopped again with the same error.
> > >
> > > Thanks,
> > >
> > > Lixin.
> > >
> > > On 2014-12-16, 7:06 AM, "Aaron Brown" 
> > > <>
> > >  wrote:
> > >
> > >> Hi Lixin,
> > >>
> > >> The Oconflict¹ error should just mean that it¹s attempting to 
> > >> re-insert
> > >> the data. Is that causing the process to stop or ?
> > >>
> > >> Cheers,
> > >> Aaron
> > >>
> > >>> On Dec 16, 2014, at 12:01 AM, Lixin Liu 
> > >>> <>
> > >>>  wrote:
> > >>>
> > >>> Hi Jason,
> > >>>
> > >>> Rerunning psb_to_esmond script again, it went a bit further, but
> > >>> failed
> > >>> again:
> > >>>
> > >>> 2014/12/15 20:46:09 (14952) INFO> psb_to_esmond.pl:286
> > >>> main::convert_owamp
> > >>> - Sending metadata....[START]
> > >>> 2014/12/15 20:46:09 (14952) INFO> psb_to_esmond.pl:345
> > >>> main::convert_owamp
> > >>> - Sending metadata....[END]
> > >>> 2014/12/15 20:46:16 (14952) INFO> psb_to_esmond.pl:272
> > >>> main::convert_owamp
> > >>> - Sending delay data for 1080253740.1241952063.1686456867....[START]
> > >>> 2014/12/15 20:48:48 (14952) ERROR> psb_to_esmond.pl:185 main:: - 
> > >>> Error
> > >>> posting 1080253740.1241952063.1686456867409 CONFLICT
> > >>>
> > >>> Any idea?
> > >>>
> > >>> Thanks,
> > >>>
> > >>> Lixin.
> > >>>
> > >>>
> > >>> On 2014-12-15, 1:28 PM, "Jason Zurawski" 
> > >>> <>
> > >>>  wrote:
> > >>>
> > >>>> Hey Lixin;
> > >>>>
> > >>>> Our usual esmond expert is away for the holidays.  I don?t think
> > >>>> there
> > >>>> is
> > >>>> any harm in re-running the script, but do note we haven?t tried 
> > >>>> this
> > >>>> failure scenario ourselves.
> > >>>>
> > >>>> Sorry to not be very helpful;
> > >>>>
> > >>>> -jason
> > >>>>
> > >>>> On Dec 15, 2014, at 4:12 PM, Lixin Liu 
> > >>>> <>
> > >>>>  wrote:
> > >>>>
> > >>>>> Hi,
> > >>>>>
> > >>>>> For some unknown reason, the migration to new DB was interrupted
> > >>>>> after a few hours. The log in /var/log/perfsonar/psb_to_esmond.log
> > >>>>> shows:
> > >>>>>
> > >>>>> 2014/12/14 03:29:29 (8021) INFO> psb_to_esmond.pl:286
> > >>>>> main::convert_owamp -
> > >>>>> Sending metadata....[START]
> > >>>>> 2014/12/14 03:29:29 (8021) INFO> psb_to_esmond.pl:345
> > >>>>> main::convert_owamp -
> > >>>>> Sending metadata....[END]
> > >>>>> 2014/12/14 03:30:01 (8021) INFO> psb_to_esmond.pl:272
> > >>>>> main::convert_owamp -
> > >>>>> Sending delay data for 1405144515.1241952063.1686456867....[START]
> > >>>>> 2014/12/14 03:39:31 (8021) ERROR> psb_to_esmond.pl:185 main:: -
> > >>>>> Error
> > >>>>> posting 1405144515.1241952063.1686456867500 Server closed 
> > >>>>> connection
> > >>>>> without
> > >>>>> sending any data back
> > >>>>>
> > >>>>> 2014/12/14 03:39:31 (8021) INFO> psb_to_esmond.pl:565
> > >>>>> main::convert_traceroute - Adding data from 2014-11-14
> > >>>>> 2014/12/14 03:39:31 (8021) INFO> psb_to_esmond.pl:569
> > >>>>> main::convert_traceroute - Finding test specs....[START]
> > >>>>> 2014/12/14 03:39:31 (8021) INFO> psb_to_esmond.pl:583
> > >>>>> main::convert_traceroute - Finding test specs....[END]
> > >>>>> ...........
> > >>>>>
> > >>>>> 2014/12/14 03:41:35 (8021) INFO> psb_to_esmond.pl:608
> > >>>>> main::convert_traceroute - Sending traceroute data for
> > >>>>> 3a00d5fea634d01080838bd3a7b148ff....[START]
> > >>>>> 2014/12/14 03:41:36 (8021) ERROR> psb_to_esmond.pl:185 main:: -
> > >>>>> Error
> > >>>>> posting 3a00d5fea634d01080838bd3a7b148ff409 CONFLICT
> > >>>>> 2014/12/14 03:41:36 (8021) INFO> psb_to_esmond.pl:742
> > >>>>> main::save_state_file - Saving state file....[START]
> > >>>>> 2014/12/14 03:41:36 (8021) INFO> psb_to_esmond.pl:750
> > >>>>> main::save_state_file - Saving state file....[END]
> > >>>>>
> > >>>>>
> > >>>>> Should I just rerun psb_to_esmond.pl script?
> > >>>>>
> > >>>>> Thanks,
> > >>>>>
> > >>>>> Lixin
> > >>>
> > >>>
> > >>
> > >
> > >