perfSONAR User Q&A and Other Discussion

["Uhl, George D. (GSFC-423.0)[SGT INC]" <>]

Andy,

I grabbed a snapshot of the esmond database records from the agent host
for tests between it and the no agent host using the following URL

https://198.118.198.5/serviceTest/graphData.cgi?action=data&url=http://loca
lhost/esmond/perfsonar/archive/&src=198.118.198.5&dest=152.61.6.5&start=142
0121813&end=1427379413&window=86400

The output is attached.  I’m hoping it can shed some light on why this
data isn’t making it to the central MA.

Thanks,
George

On 3/26/15, 4:16 PM, "Uhl, George D. (GSFC-423.0)[SGT INC]"
<>
 wrote:

>Andy,
>
>It’s not a FW issue. I can reach the central MA from the problematic host
>over ports 80 and 443. Both are running iptables that I control and there
>is no other firewall in the path.
>
>Thanks,
>George
>
>On 3/26/15, 2:10 PM, "Andrew Lake" 
><>
> wrote:
>
>>Hi George,
>>
>>That could definitely be it. If this is the only host experiencing that
>>problem and since I believe you use a central MA, could it just be a
>>firewall causing the timeout?
>>
>>Thanks,
>>Andy
>>
>>
>>On Mar 26, 2015, at 1:51 PM, "Uhl, George D. (GSFC-423.0)[SGT INC]"
>><>
>> wrote:
>>
>>> Andy,
>>> 
>>> In the regular_testing log file on the agent host that’s unable to
>>> transmit data to the central MA, I have the following repeating error
>>> message sequence:
>>> 
>>> 2015/03/26 13:25:13 (10072) ERROR> EsmondBase.pm:53
>>> perfSONAR_PS::RegularTesting::MeasurementArchives::EsmondBase::__ANON__
>>>-
>>> Error writing metadata (500) 500 Timeout
>>> 2015/03/26 13:25:13 (10072) ERROR> MeasurementArchiveChild.pm:209
>>> 
>>>perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::handle_re
>>>s
>>>ul
>>> ts - Problem storing results: Error writing metadata: 500 Timeout
>>> 2015/03/26 13:25:13 (10072) ERROR> MeasurementArchiveChild.pm:125
>>> perfSONAR_PS::RegularTesting::Master::MeasurementArchiveChild::__ANON__
>>>-
>>> Problem handling test results: Problem storing results: Error writing
>>> metadata: 500 Timeout at
>>> 
>>>/opt/perfsonar_ps/regular_testing/bin/../lib/perfSONAR_PS/RegularTesting
>>>/
>>>Ma
>>> ster/MeasurementArchiveChild.pm line 122.
>>> 
>>> 
>>> Could this be an indication of the problem?
>>> 
>>> Thanks,
>>> George
>>> 
>>> On 3/25/15, 3:05 PM, "Uhl, George D. (GSFC-423.0)[SGT INC]"
>>> <>
>>>  wrote:
>>> 
>>>> Hi Andy,
>>>> 
>>>> In the statistics page that displays after I click on the on the
>>>>orange
>>>> cell, I get this:
>>>> 
>>>> graphUrl: 
>>>> 
>>>>http://archive.eos.nasa.gov/serviceTest/graphWidget.cgi?url=http://arch
>>>>i
>>>>ve
>>>> .
>>>> 
>>>>eos.nasa.gov/esmond/perfsonar/archive/&dest=edclxw41.cr.usgs.gov&source
>>>>=
>>>>es
>>>> d
>>>> is-ps.eosdis.nasa.gov
>>>> maUrl: http://archive.eos.nasa.gov/esmond/perfsonar/archive/
>>>> 
>>>> 
>>>> When I click on a cell with current data, I get this:
>>>> 
>>>> Count: 112
>>>> graphUrl: 
>>>> 
>>>>http://archive.eos.nasa.gov/serviceTest/graphWidget.cgi?url=http://arch
>>>>i
>>>>ve
>>>> .
>>>> 
>>>>eos.nasa.gov/esmond/perfsonar/archive/&dest=nasatest2.asf.alaska.edu&so
>>>>u
>>>>rc
>>>> e
>>>> =esdis-ps.eosdis.nasa.gov
>>>> Max: 4
>>>> Standard_Deviation: 0.6628955437552
>>>> Average: 0.330357142857143
>>>> maUrl: http://archive.eos.nasa.gov/esmond/perfsonar/archive/
>>>> Min: 0
>>>> 
>>>> 
>>>> Thanks,
>>>> George
>>>> 
>>>> On 3/23/15, 8:57 AM, "Andrew Lake" 
>>>> <>
>>>>  wrote:
>>>> 
>>>>> Hi George,
>>>>> 
>>>>> A no_agent host means that it cannot initiate tests or register any
>>>>>data
>>>>> to an MA. All it should do it make both the top and the bottom of the
>>>>>box
>>>>> use the MA set for the host that has the agent. If you click on the
>>>>> orange box, on the page that loads the details of the check you
>>>>>should
>>>>> see a vertical tab labelled "Statistics". Click on that to expand it
>>>>>and
>>>>> verify it has the correct MA set for the maUrl displayed.
>>>>> 
>>>>> Thanks,
>>>>> Andy
>>>>> 
>>>>> On Mar 19, 2015, at 1:52 PM, "Uhl, George D. (GSFC-423.0)[SGT INC]"
>>>>> <>
>>>>>  wrote:
>>>>> 
>>>>>> Andy,
>>>>>> 
>>>>>> I can run the tests by hand without a problem.  When I go to the
>>>>>> toolkit page of esdis-ps.eosdis.nasa.gov and display the throughput
>>>>>>and
>>>>>> latency/loss graphs I have current data (see attached).  I verified
>>>>>> connectivity to the standalone MA over port 80 & 443.  In a mesh,
>>>>>>which
>>>>>> hosts are reporting test results to the MA - the source, the
>>>>>>destination
>>>>>> or both?  What happens if one of them is a no_agent host?
>>>>>> 
>>>>>> In my case I have two agent hosts testing with one no_agent host.
>>>>>>On
>>>>>> both agent hosts, the throughput/latency/loss graphs shows the
>>>>>>source is
>>>>>> the no_agent host and the destination is the agent host.  Yet agent
>>>>>>host
>>>>>> is able to send data to the central MA,it¹s displaying on the
>>>>>>dashboard,
>>>>>> while the other is not.
>>>>>> 
>>>>>> I¹m not sure what log files will indicate the cause of the failure.
>>>>>> 
>>>>>> Thanks,
>>>>>> George
>>>>>> 
>>>>>> From: Andrew Lake 
>>>>>> <>
>>>>>> Date: Wednesday, March 18, 2015 at 4:44 PM
>>>>>> To: George Uhl 
>>>>>> <>
>>>>>> Cc: perfsonar-user 
>>>>>> <>
>>>>>> Subject: Re: [perfsonar-user] Dashboard unable to retrieve data
>>>>>> 
>>>>>> Hi george,
>>>>>> 
>>>>>> Looking at the data it appears the OWAMP tests stopped working
>>>>>>around
>>>>>> January 26th and the BWCTL tests ~January 23rd. You might want to
>>>>>>double
>>>>>> check the test is still configured. Could also be a firewall change
>>>>>> maybe? If you run owping or bwctl by hand do the tests complete?
>>>>>> 
>>>>>> Thanks,
>>>>>> Andy
>>>>>> 
>>>>>> 
>>>>>> On Mar 18, 2015, at 9:42 AM, "Uhl, George D. (GSFC-423.0)[SGT INC]"
>>>>>> <>
>>>>>>  wrote:
>>>>>> 
>>>>>>> 
>>>>>>> I have a situation where I¹m unable to retrieve data from OWAMP or
>>>>>>> BWCTL/iperf tests between two nodes on my dashboard.  The dashboard
>>>>>>>is
>>>>>>> run on a standalone centralized MA and I see test results data
>>>>>>>between
>>>>>>> these hosts in the esmond perfsonar archive.  One node,
>>>>>>> esdis-ps.eosdis.nasa.gov is participating in a mesh.  The other
>>>>>>>node,
>>>>>>> edclxw41.cr.usgs.gov is a no_agent mesh member.  This same no_agent
>>>>>>> member is running tests with another member, 207.151.223.222, and
>>>>>>>those
>>>>>>> results are being displayed in the dashboard.   I¹ve attached a
>>>>>>>gzipped
>>>>>>> copy of the esmond archive from the MA and a screen shot of the
>>>>>>> dashboard.
>>>>>>> 
>>>>>>> Thanks,
>>>>>>> George
>>>>>>> <MAesmondPSarchive.json.gz><Screen Shot 2015-03-18 at 9.37.00
>>>>>>>AM.png>
>>>>>> 
>>>>>> <Screen Shot 2015-03-19 at 1.18.13 PM.png>
>>>>> 
>>
>

{"error_src":[[1420921430,"Problem parsing traceroute output: Can't find hop 
number in output: send: Operation not permitted at 
/usr/share/perl5/vendor_perl/Net/Traceroute.pm line 
613.\n"],[1421193308,"Problem parsing traceroute output: Can't find hop 
number in output: send: Operation not permitted at 
/usr/share/perl5/vendor_perl/Net/Traceroute.pm line 
613.\n"],[1421332399,"Problem parsing traceroute output: Can't find hop 
number in output: send: Operation not permitted at 
/usr/share/perl5/vendor_perl/Net/Traceroute.pm line 
613.\n"],[1421571686,"Problem parsing traceroute output: Can't find hop 
number in output: send: Operation not permitted at 
/usr/share/perl5/vendor_perl/Net/Traceroute.pm line 
613.\n"],[1421698449,"Problem parsing traceroute output: Can't find hop 
number in output: send: Operation not permitted at 
/usr/share/perl5/vendor_perl/Net/Traceroute.pm line 
613.\n"],[1421972297,"Problem parsing traceroute output: Can't find hop 
number in output: send: Operation not permitted at 
/usr/share/perl5/vendor_perl/Net/Traceroute.pm line 
613.\n"],[1422536331,"Problem parsing traceroute output: Can't find hop 
number in output: send: Operation not permitted at 
/usr/share/perl5/vendor_perl/Net/Traceroute.pm line 
613.\n"],[1422707358,"Problem parsing traceroute output: Can't find hop 
number in output: send: Operation not permitted at 
/usr/share/perl5/vendor_perl/Net/Traceroute.pm line 
613.\n"],[1423043009,"Problem parsing traceroute output: Can't find hop 
number in output: send: Operation not permitted at 
/usr/share/perl5/vendor_perl/Net/Traceroute.pm line 
613.\n"],[1423740435,"Problem parsing traceroute output: Can't find hop 
number in output: send: Operation not permitted at 
/usr/share/perl5/vendor_perl/Net/Traceroute.pm line 
613.\n"],[1424628835,"Problem parsing traceroute output: Can't find hop 
number in output: send: Operation not permitted at 
/usr/share/perl5/vendor_perl/Net/Traceroute.pm line 
613.\n"],[1424744363,"Problem parsing traceroute output: Can't find hop 
number in output: send: Operation not permitted at 
/usr/share/perl5/vendor_perl/Net/Traceroute.pm line 
613.\n"],[1425519825,"Problem parsing traceroute output: Can't find hop 
number in output: send: Operation not permitted at 
/usr/share/perl5/vendor_perl/Net/Traceroute.pm line 
613.\n"],[1425643957,"Problem parsing traceroute output: Can't find hop 
number in output: send: Operation not permitted at 
/usr/share/perl5/vendor_perl/Net/Traceroute.pm line 
613.\n"],[1426277627,"Problem parsing traceroute output: Can't find hop 
number in output: send: Operation not permitted at 
/usr/share/perl5/vendor_perl/Net/Traceroute.pm line 613.\n"],[1420284353,"No 
results"],[1420298085,"No results"],[1420313552,"No results"],[1420328754,"No 
results"],[1420343585,"No results"],[1420358350,"No results"],[1420372035,"No 
results"],[1420386347,"No results"],[1420401102,"No results"],[1420572694,"No 
results"],[1420587405,"No results"],[1420602143,"No results"],[1420617207,"No 
results"],[1420632240,"No results"],[1420646516,"No results"],[1420662137,"No 
results"],[1420676450,"No results"],[1420691316,"No results"],[1420851139,"No 
results"],[1420866329,"No results"],[1420881345,"No results"],[1420894511,"No 
results"],[1420907562,"No results"],[1420922163,"No results"],[1421052768,"No 
results"],[1421068366,"No results"],[1421083265,"No results"],[1421097349,"No 
results"],[1421112729,"No results"],[1421126101,"No results"],[1421255996,"No 
results"],[1421269459,"No results"],[1421284739,"No results"],[1421297849,"No 
results"],[1421313543,"No results"],[1421327997,"No results"],[1421341314,"No 
results"],[1421458106,"No results"],[1421473804,"No results"],[1421487979,"No 
results"],[1421502874,"No results"],[1421518329,"No results"],[1421531565,"No 
results"],[1421544703,"No results"],[1421676048,"No results"],[1421689760,"No 
results"],[1421702800,"No results"],[1421717192,"No results"],[1421730344,"No 
results"],[1421743534,"No results"],[1421871881,"No results"],[1421884976,"No 
results"],[1421900345,"No results"],[1421915775,"No results"],[1421930086,"No 
results"],[1421944511,"No results"],[1422074181,"No results"],[1422087202,"No 
results"],[1422103031,"No results"],[1422118728,"No results"],[1422126583,"No 
results"],[1422142153,"No results"],[1422155120,"No results"],[1422314441,"No 
results"],[1422329919,"No results"],[1422344717,"No results"],[1422360169,"No 
results"],[1422375462,"No results"],[1422511431,"No results"],[1422525633,"No 
results"],[1422540666,"No results"],[1422555014,"No results"],[1422568075,"No 
results"],[1422581228,"No results"],[1422687888,"No results"],[1422701529,"No 
results"],[1422714982,"No results"],[1422730683,"No results"],[1422744084,"No 
results"],[1422757572,"No results"],[1422773156,"No results"],[1422787526,"No 
results"],[1422904288,"No results"],[1422917405,"No results"],[1422933178,"No 
results"],[1422948291,"No results"],[1422963536,"No results"],[1422979237,"No 
results"],[1422992860,"No results"],[1423108179,"No results"],[1423121150,"No 
results"],[1423134990,"No results"],[1423148508,"No results"],[1423162047,"No 
results"],[1423177066,"No results"],[1423192732,"No results"],[1423292994,"No 
results"],[1423308336,"No results"],[1423322844,"No results"],[1423338077,"No 
results"],[1423353604,"No results"],[1423368967,"No results"],[1423482252,"No 
results"],[1423496309,"No results"],[1423510824,"No results"],[1423517517,"No 
results"],[1423533111,"No results"],[1423546573,"No results"],[1423657303,"No 
results"],[1423672685,"No results"],[1423686313,"No results"],[1423700367,"No 
results"],[1423714799,"No results"],[1423730309,"No results"],[1423844053,"No 
results"],[1423858619,"No results"],[1423873190,"No results"],[1423887765,"No 
results"],[1423903014,"No results"],[1424016307,"No results"],[1424031955,"No 
results"],[1424046309,"No results"],[1424060754,"No results"],[1424076516,"No 
results"],[1424091788,"No results"],[1424193410,"No results"],[1424207658,"No 
results"],[1424222767,"No results"],[1424238066,"No results"],[1424252253,"No 
results"],[1424266262,"No results"],[1424382075,"No results"],[1424397540,"No 
results"],[1424411471,"No results"],[1424426592,"No results"],[1424440118,"No 
results"],[1424554308,"No results"],[1424569942,"No results"],[1424584768,"No 
results"],[1424600166,"No results"],[1424613822,"No results"],[1424628457,"No 
results"],[1424742352,"No results"],[1424757081,"No results"],[1424770169,"No 
results"],[1424785104,"No results"],[1424799077,"No results"],[1424912017,"No 
results"],[1424926497,"No results"],[1424940446,"No results"],[1424955947,"No 
results"],[1424970723,"No results"],[1424986442,"No results"],[1425102538,"No 
results"],[1425117014,"No results"],[1425130274,"No results"],[1425144891,"No 
results"],[1425158478,"No results"],[1425272015,"No results"],[1425286058,"No 
results"],[1425300481,"No results"],[1425315995,"No results"],[1425331146,"No 
results"],[1425344203,"No results"],[1425458523,"No results"],[1425474195,"No 
results"],[1425489364,"No results"],[1425503071,"No results"],[1425516436,"No 
results"],[1425618660,"No results"],[1425633205,"No results"],[1425648230,"No 
results"],[1425663076,"No results"],[1425677246,"No results"],[1425692729,"No 
results"],[1425708493,"No results"],[1426006954,"No results"],[1426020967,"No 
results"],[1426035237,"No results"],[1426049254,"No results"],[1426064946,"No 
results"],[1426079463,"No results"],[1426168305,"No results"],[1426183510,"No 
results"],[1426198521,"No results"],[1426211823,"No results"],[1426226827,"No 
results"],[1426240377,"No results"],[1426256011,"No results"],[1426360806,"No 
results"],[1426376356,"No results"],[1426390279,"No results"],[1426403707,"No 
results"],[1426418873,"No results"],[1426432884,"No results"],[1426538947,"No 
results"],[1426540622,"No results"],[1426554416,"No results"],[1426569075,"No 
results"],[1426583748,"No results"],[1426597003,"No results"],[1426603220,"No 
results"],[1426713874,"No results"],[1426727079,"No results"],[1426740773,"No 
results"],[1426756418,"No results"],[1426770995,"No results"],[1426784809,"No 
results"],[1426905964,"No results"],[1426920046,"No results"],[1426933562,"No 
results"],[1426948902,"No results"],[1426963894,"No results"],[1427081862,"No 
results"],[1427094841,"No results"],[1427109024,"No results"],[1427122762,"No 
results"],[1427136682,"No results"],[1427151047,"No results"],[1427265837,"No 
results"],[1427280904,"No results"],[1427294149,"No results"],[1427297974,"No 
results"],[1427313195,"No results"],[1427326332,"No 
results"]],"throughput_src":[[1420129609,828525505],[1420143958,565329018],[1420158750,840371629],[1420172779,848150522],[1420185988,278434403],[1420201364,760241824],[1420214881,772177363],[1420229999,451938566],[1420243551,605618149],[1420257004,771021654],[1420271067,762312357],[1420416889,756671634],[1420430492,762844091],[1420443714,416325746],[1420457498,801856480],[1420472839,692393078],[1420487936,606941121],[1420501289,713729864],[1420516448,670739245],[1420529497,798161334],[1420542838,750523622],[1420558625,828344061],[1420704551,676949556],[1420719969,804505478],[1420735161,576502969],[1420749171,521873527],[1420764216,793274399],[1420778771,801737368],[1420791771,800114167],[1420805741,831998261],[1420821093,440704700],[1420835355,529533403],[1420937467,739984082],[1420950910,784107684],[1420964832,846723013],[1420980172,838063182],[1420994052,611990502],[1421007921,645620922],[1421021414,731814221],[1421037120,563403958],[1421139211,828881130],[1421154869,779662669],[1421170698,470782115],[1421186043,622882403],[1421199869,492352240],[1421214904,755217047],[1421228962,610251870],[1421242829,517531797],[1421357100,482664398],[1421370317,621598722],[1421385980,557513472],[1421399368,614722856],[1421413547,682760826],[1421428709,549563182],[1421443018,459846412],[1421559701,860963516],[1421573349,852534361],[1421586672,856664944],[1421601472,816018770],[1421615091,869805413],[1421630763,857697083],[1421646454,798060113],[1421757782,811383016],[1421772428,826057898],[1421785975,495364080],[1421800169,644253145],[1421815073,836356557],[1421828442,386823878],[1421843067,816019665],[1421856309,829464529],[1421959557,448185213],[1421974144,475065484],[1421988750,644997296],[1422002952,617361325],[1422018227,705309614],[1422033161,634355819],[1422046340,313002863],[1422059474,544820169],[1422389357,424180643],[1422397071,689461011],[1422411458,737832709],[1422424874,240312186],[1422439452,661604290],[1422454628,694646758],[1422466046,614160385],[1422481053,689082670],[1422496091,744355555],[1422596274,351343129],[1422611678,518824971],[1422625402,458028693],[1422640714,475168894],[1422643908,355901347],[1422645000,250090266],[1422647385,460355712],[1422663110,489568058],[1422676166,728029051],[1422800558,822632589],[1422816080,553953510],[1422830784,544520121],[1422845094,729651872],[1422858673,564669857],[1422873472,433258913],[1422888479,337240298],[1423007148,229295948],[1423022823,572260299],[1423036234,680845750],[1423051675,599020926],[1423064772,561382623],[1423079137,472018037],[1423092490,524868483],[1423205823,554348622],[1423219428,780288363],[1423233462,698372821],[1423247510,294320512],[1423250827,487468895],[1423265805,562397165],[1423279259,839362448],[1423384276,863255773],[1423397607,737876078],[1423412160,621503101],[1423425143,817785824],[1423440221,513277080],[1423453446,715281287],[1423467956,566449739],[1423560842,38538914],[1423574367,50165740],[1423589069,655976353],[1423603428,493687074],[1423616430,868906275],[1423629505,766478259],[1423643475,624003503],[1423744367,566776392],[1423757679,606163517],[1423773080,479595398],[1423786554,595091407],[1423802332,813102878],[1423817091,685925277],[1423830884,841142768],[1423916337,13790204],[1423930405,120108177],[1423943830,25430393],[1423958329,28447792],[1423972168,11274020],[1423986070,16682811],[1424001906,34852970],[1424107193,594497812],[1424122497,577297321],[1424135560,707255807],[1424149181,591042218],[1424163076,852515659],[1424178690,858115244],[1424279533,737307259],[1424293965,26790722],[1424309548,16083341],[1424324429,34196417],[1424337564,24245663],[1424352676,32228443],[1424367831,45779265],[1424454046,814306792],[1424467732,877553512],[1424481064,892538565],[1424496389,878815654],[1424511578,784233474],[1424524815,728570441],[1424539573,808378046],[1424642734,786098070],[1424657681,759010625],[1424671619,709564595],[1424685321,708953952],[1424698615,855775946],[1424713568,636444093],[1424727618,345411036],[1424814366,27286852],[1424827679,38737598],[1424841217,16759941],[1424854683,20698442],[1424870158,21079847],[1424884264,385090287],[1424898699,29439154],[1425000865,15943368],[1425015406,16106976],[1425030143,43718761],[1425044125,35247353],[1425059361,12967091],[1425072893,33265283],[1425088194,50802509],[1425172767,569565376],[1425186338,468894002],[1425201696,545524992],[1425216112,498996046],[1425231636,491923740],[1425245067,593188596],[1425259018,535911612],[1425357193,25814639],[1425370987,25909897],[1425385002,17922701],[1425400563,11597254],[1425416173,503126307],[1425430067,286610914],[1425444214,36955460],[1425531065,30556246],[1425546156,39658701],[1425561035,417601646],[1425575906,564812984],[1425589834,378927852],[1425605343,444260560],[1425722757,256237977],[1425736424,577135650],[1425750808,682264732],[1425764747,546938790],[1425777733,408291364],[1425908841,37898777],[1425922010,19475538],[1425935863,26671921],[1425949113,23983621],[1425964478,26855125],[1425979947,24478516],[1425993549,58941552],[1426082397,800286478],[1426098094,13496364],[1426112913,25232557],[1426126417,21320308],[1426139870,18561453],[1426154539,33961844],[1426270031,279678113],[1426285862,28505598],[1426300444,29502276],[1426314546,25072690],[1426330208,65580183],[1426345385,20679208],[1426447525,12424389],[1426463216,14304865],[1426476674,13982737],[1426491303,17377404],[1426506662,25009856],[1426521718,9295323],[1426524606,39205025],[1426616707,56485652],[1426630298,63019510],[1426645874,106307446],[1426660311,47881702],[1426673616,57762436],[1426687516,129140660],[1426700658,32035376],[1426800456,24487422],[1426815782,24595539],[1426830705,32194470],[1426846210,18215478],[1426861269,13361222],[1426875890,10437845],[1426891682,11292952],[1426979253,44474346],[1426994492,18231406],[1427009025,12350859],[1427024003,11610561],[1427039671,13660543],[1427052951,47495848],[1427068470,81270690],[1427165041,14129040],[1427179206,20504532],[1427194305,19620400],[1427208107,9754520],[1427223886,16555346],[1427236961,28217402],[1427250570,13061899],[1427342094,7469523],[1427348987,18592320],[1427349729,9867396],[1427378952,17617417]],"owdelay_minimum_dst":[[1420156800,18.8],[1420243200,26.6],[1420329600,26.6],[1420416000,26.5],[1420502400,26.5],[1420588800,26.6],[1420675200,26.5],[1420761600,26.6],[1420848000,26.6],[1420934400,26.6],[1421020800,26.5],[1421107200,26.6],[1421193600,26.6],[1421280000,26.6],[1421366400,26.3],[1421452800,26.4],[1421539200,26.6],[1421625600,26.3],[1421712000,26.7],[1421798400,26.6],[1421884800,26.8],[1421971200,26.2],[1422057600,26.7],[1422144000,25.7],[1422230400,24.7],[1422316800,26.2],[1422403200,12.2],[1422489600,26.7],[1422576000,24.6],[1422662400,25.7],[1422748800,26],[1422835200,26.3],[1422921600,25.9],[1423008000,26.2],[1423094400,23.6],[1423180800,26.2],[1423267200,26.2],[1423353600,26.2],[1423440000,24.9],[1423526400,26],[1423612800,26],[1423699200,24],[1423785600,26.6],[1423872000,26.1],[1423958400,26.1],[1424044800,25.9],[1424131200,26],[1424217600,26.3],[1424304000,26.4],[1424390400,26.4],[1424476800,26.3],[1424563200,24.3],[1424649600,18.4],[1424736000,26.1],[1424822400,27.2],[1424908800,27.2],[1424995200,27.2],[1425081600,27.3],[1425168000,27.2],[1425254400,27],[1425340800,27.2],[1425427200,27.1],[1425513600,27],[1425600000,19.2],[1425686400,26.6],[1425772800,58],[1425859200,20.8],[1425945600,26.6],[1426032000,26.7],[1426118400,26.7],[1426204800,26.6],[1426291200,26.7],[1426377600,26.5],[1426464000,26.8],[1426550400,24.1],[1426636800,26.4],[1426723200,26.8],[1426809600,26.7],[1426896000,25.7],[1426982400,26.8],[1427068800,26.6],[1427155200,26.5],[1427241600,26.5],[1427328000,26.8]],"owdelay_median_src":[[1420156800,23.4],[1420243200,23.3],[1420329600,23.4],[1420416000,23.4],[1420502400,23.4],[1420588800,23.4],[1420675200,23.4],[1420761600,23.4],[1420848000,23.4],[1420934400,23.4],[1421020800,23.3],[1421107200,23.3],[1421193600,23.3],[1421280000,23.4],[1421366400,23.3],[1421452800,23.4],[1421539200,23.4],[1421625600,23.3],[1421712000,23.2],[1421798400,23.3],[1421884800,22.8],[1421971200,22.9],[1422057600,22.6],[1422144000,22.2],[1422230400,21.4],[1422316800,22.6],[1422403200,22.5],[1422489600,22.7],[1422576000,22.6],[1422662400,22.6],[1422748800,22.6],[1422835200,22.6],[1422921600,22.5],[1423008000,22.5],[1423094400,22.6],[1423180800,22.5],[1423267200,22.6],[1423353600,22.6],[1423440000,22.6],[1423526400,28.5],[1423612800,22.8],[1423699200,22.9],[1423785600,22.6],[1423872000,104.5],[1423958400,85.4],[1424044800,22.5],[1424131200,22.6],[1424217600,23.1],[1424304000,106.3],[1424390400,23.3],[1424476800,23.1],[1424563200,23.1],[1424649600,23.2],[1424736000,23.3],[1424822400,30.2],[1424908800,37],[1424995200,79.7],[1425081600,47],[1425168000,24.1],[1425254400,24.2],[1425340800,25.1],[1425427200,42.7],[1425513600,24.3],[1425600000,24.1],[1425686400,24.1],[1425772800,-54],[1425859200,-70.9],[1425945600,60.6],[1426032000,32.2],[1426118400,25],[1426204800,27.7],[1426291200,24.6],[1426377600,24.5],[1426464000,24.3],[1426550400,24.1],[1426636800,24.1],[1426723200,24.6],[1426809600,24.4],[1426896000,24.2],[1426982400,24.2],[1427068800,24.2],[1427155200,24.3],[1427241600,24.2],[1427328000,24.2]],"throughput_dst":[[1420131228,466600045],[1420145156,666331602],[1420160554,348735486],[1420175134,325515695],[1420189938,510449543],[1420204028,620909448],[1420217158,510502075],[1420231212,285225168],[1420246529,419713550],[1420260741,283217390],[1420275813,551134463],[1420290611,654391723],[1420305162,420633647],[1420319263,415354088],[1420334924,499045884],[1420348705,648232623],[1420364247,676292955],[1420379787,220691547],[1420394845,664722047],[1420409348,434883521],[1420423765,575299771],[1420437005,673002187],[1420450348,213795822],[1420465423,676936998],[1420478658,533970137],[1420494434,651822961],[1420509331,352477685],[1420523931,158197027],[1420538514,661260414],[1420552180,148905782],[1420566689,224239359],[1420579905,320295380],[1420594539,528968767],[1420608696,128148883],[1420623466,187750955],[1420637040,17475918],[1420652238,171398503],[1420667246,103460929],[1420681939,171584754],[1420696613,428787466],[1420709996,201794723],[1420723918,355153223],[1420737553,142598055],[1420752526,206963300],[1420767591,236928100],[1420781045,47459131],[1420796841,76660994],[1420811610,486177669],[1420824764,169118352],[1420839778,16697703],[1420853210,514771450],[1420867895,602388902],[1420883152,189221392],[1420896931,44541326],[1420910777,422429591],[1420926344,676402633],[1420940084,653487627],[1420955882,283160969],[1420970208,705446460],[1420985573,653224287],[1420999197,386196874],[1421012195,692149162],[1421027847,263950900],[1421043114,325041657],[1421057220,661776286],[1421071838,665213285],[1421084895,268055442],[1421098359,200127004],[1421112146,388103906],[1421126935,201365230],[1421142116,123710099],[1421156325,623616522],[1421172078,244945326],[1421185053,144492499],[1421198396,283132435],[1421213375,307696238],[1421226845,347793288],[1421240144,629392276],[1421254050,51706805],[1421267714,114891973],[1421283068,109429133],[1421297448,502914314],[1421312763,209705825],[1421327569,123182593],[1421342806,122073957],[1421356145,162164770],[1421370662,231166357],[1421383799,328580544],[1421397082,244546718],[1421410102,315850752],[1421425643,38524171],[1421439591,68414752],[1421452650,42098362],[1421467973,89513078],[1421481378,158191462],[1421495584,134141338],[1421509686,38989586],[1421523188,63555791],[1421537900,116704069],[1421552834,185595675],[1421568160,200007463],[1421582212,138931007],[1421595513,73077505],[1421610757,133853724],[1421624844,88244245],[1421638508,127935817],[1421652891,166876399],[1421667469,248168794],[1421681491,157467630],[1421696821,221955882],[1421712104,193692516],[1421725639,159016952],[1421739510,217653262],[1421754269,181207350],[1421769650,68722094],[1421782926,32436783],[1421798039,45160224],[1421812116,69239271],[1421825573,25088365],[1421841004,53626548],[1421855142,26272931],[1421868290,51973546],[1421881840,23861137],[1421896079,43021210],[1421911591,41968944],[1421925587,87741029],[1421941071,22525996],[1421954846,66590111],[1421969473,39981020],[1421983740,66987814],[1421999485,75559898],[1422013518,69824841],[1422028963,59730317],[1422042171,38208842],[1422055604,51690352],[1422069279,67253855],[1422083209,44336083],[1422098066,54314510],[1422113360,78645544],[1422125915,80284463],[1422141712,100948001],[1422156717,42991358],[1422312576,68495482],[1422326692,74398551],[1422341494,100208666],[1422355577,118703354],[1422370745,92588319],[1422384698,63676545],[1422411627,49070175],[1422426473,62628720],[1422439930,27807582],[1422454001,81265846],[1422466150,71756732],[1422479892,99826348],[1422495313,115685524],[1422509576,123561460],[1422523619,86457908],[1422539063,109547430],[1422553529,180533216],[1422568816,164443576],[1422582900,45234817],[1422596959,279377272],[1422612614,103352107],[1422627368,89365309],[1422642109,100986965],[1422644549,139928037],[1422647455,72754760],[1422661461,70402503],[1422674514,127080735],[1422688736,71800089],[1422702678,96512071],[1422717338,146628810],[1422731401,404992865],[1422744797,28301100],[1422759883,114060597],[1422773064,21630090],[1422788760,61122614],[1422802507,173442414],[1422815501,106677056],[1422830747,104187198],[1422844802,81306469],[1422860485,126321348],[1422873811,63671221],[1422889291,63004010],[1422904105,87826630],[1422917893,65389222],[1422931432,70035438],[1422946145,84585840],[1422961379,110470289],[1422975750,38785766],[1422990231,186016431],[1423003679,84385929],[1423017984,127493686],[1423031473,157872325],[1423046004,100513296],[1423059778,85957843],[1423073843,55301701],[1423087260,62050924],[1423102065,71125057],[1423115117,107568662],[1423130784,74354162],[1423146676,99223107],[1423162082,57241612],[1423175460,47630150],[1423190649,232464507],[1423204696,174173387],[1423219537,129575742],[1423234313,63619679],[1423247473,111470725],[1423250470,89061956],[1423265842,143575916],[1423279223,68944770],[1423294302,231448225],[1423307936,52868129],[1423322916,135902693],[1423336839,243679379],[1423352430,101819836],[1423368162,141286581],[1423383304,173449152],[1423398526,81763041],[1423413305,117522209],[1423426631,132630496],[1423441317,239956592],[1423454351,111593016],[1423468522,94490883],[1423483591,84369782],[1423497721,50356670],[1423511180,25173969],[1423517953,20051762],[1423531475,27296480],[1423545526,47183080],[1423558900,57678098],[1423574505,16640369],[1423589775,33913124],[1423604621,102200756],[1423618278,71843968],[1423631761,99430696],[1423647563,58861341],[1423661925,108350585],[1423675422,11718958],[1423689430,41827644],[1423703438,77895556],[1423719148,78569743],[1423734242,72081966],[1423747298,75954532],[1423761402,17418123],[1423775714,92547788],[1423791279,146439498],[1423804541,131898582],[1423819150,156139544],[1423833207,85046473],[1423846608,79089233],[1423861392,97768123],[1423874704,63930887],[1423887801,59454950],[1423902437,69451392],[1423916391,73750152],[1423931450,121013983],[1423947154,144191599],[1423960330,159299542],[1423975987,168177124],[1423989890,67927233],[1424003474,36428169],[1424018875,120981905],[1424032276,55949315],[1424047633,154899652],[1424060773,112220175],[1424074744,119420682],[1424090147,84935994],[1424104691,28705892],[1424119166,186365763],[1424132768,211545577],[1424148350,245892541],[1424162720,132252848],[1424178443,346780435],[1424194121,188097603],[1424209623,167927740],[1424223833,110038039],[1424239235,311059920],[1424255040,183593233],[1424268014,301763577],[1424281638,59898908],[1424295011,58650224],[1424309816,19529942],[1424323874,146013287],[1424337278,123040954],[1424350878,65663718],[1424365848,9194317],[1424381475,108535790],[1424394914,192964632],[1424410099,171240480],[1424425490,219060379],[1424439922,77575752],[1424455683,72984698],[1424470652,381719828],[1424485474,129266849],[1424500841,97133193],[1424515991,147002364],[1424531813,233385645],[1424546754,419969517],[1424560610,313943717],[1424575067,185396106],[1424590674,343345367],[1424604248,303368135],[1424617223,267630338],[1424632706,384126366],[1424646140,181321796],[1424661657,323049332],[1424675511,443233700],[1424688508,328352770],[1424703991,167586865],[1424717860,264181306],[1424731520,154813204],[1424744529,219115558],[1424760238,174815355],[1424774916,206706870],[1424788466,190163463],[1424801934,144721369],[1424815745,165282346],[1424829052,72343200],[1424843028,130841982],[1424856178,213490606],[1424871920,195072555],[1424887351,420352688],[1424900442,96066814],[1424915308,229703125],[1424929751,240205110],[1424945224,313220311],[1424959403,150427793],[1424973793,226371219],[1424988429,121834010],[1425003478,129238593],[1425016486,149759130],[1425030840,342068308],[1425046552,95003232],[1425059575,168976372],[1425073573,145521480],[1425086905,109536337],[1425102462,221397957],[1425117355,99725235],[1425130699,231659147],[1425145922,256842620],[1425161724,99760833],[1425175771,109182777],[1425191045,287119362],[1425206722,523963433],[1425222479,108820577],[1425235464,428875009],[1425248766,338927685],[1425262513,312516967],[1425275833,263971515],[1425290150,234308589],[1425304071,178488458],[1425317305,215389474],[1425331220,174549104],[1425345273,282882902],[1425360413,502625750],[1425375778,210044155],[1425389499,212486108],[1425402977,34867023],[1425416892,131257160],[1425432264,218280130],[1425447858,153308920],[1425461823,168990166],[1425475710,328807265],[1425491174,492851651],[1425505203,227485317],[1425520129,198271511],[1425535943,287225316],[1425549711,133164907],[1425563699,80337109],[1425577009,221966754],[1425590162,250227027],[1425604104,117669947],[1425618510,308830439],[1425633976,628568370],[1425647750,221141719],[1425662077,104022288],[1425677571,199351513],[1425691686,163977568],[1425706784,107667243],[1425719776,239531508],[1425735250,179767961],[1425748428,190449406],[1425761696,225449121],[1425775254,239379120],[1425909280,33865297],[1425923435,22471079],[1425937620,173908462],[1425950748,541375351],[1425964872,360054531],[1425980463,266072010],[1425993609,285766682],[1426007655,73211725],[1426020660,11728799],[1426036152,122772631],[1426051157,145113822],[1426064348,234234077],[1426078808,257425284],[1426082361,99787674],[1426096349,70637476],[1426111344,103678812],[1426125181,149951720],[1426139007,116730928],[1426153363,89592060],[1426166649,86863474],[1426179795,19082923],[1426193546,67737415],[1426207828,120196575],[1426222072,96114957],[1426236259,59167210],[1426251335,100329024],[1426266153,60280826],[1426281830,27980129],[1426296624,97149810],[1426311572,102448754],[1426326177,35801372],[1426340146,27853032],[1426353822,9947179],[1426369491,82058247],[1426384167,67169152],[1426398853,82247292],[1426412472,84845308],[1426425745,157072735],[1426439837,117958159],[1426452834,82637722],[1426466759,184992686],[1426481024,234081336],[1426496428,127358131],[1426511683,174996893],[1426523968,390005323],[1426538382,157559183],[1426539211,71730303],[1426540857,223202244],[1426556213,137024141],[1426571481,226903459],[1426586630,99826145],[1426599720,229110979],[1426603306,118256843],[1426618302,193934555],[1426631907,190363354],[1426646540,443767206],[1426660728,341777859],[1426674138,315118916],[1426689634,184699159],[1426702859,126088582],[1426717490,74441168],[1426731517,108712091],[1426744790,235015271],[1426757889,253146493],[1426772246,71711345],[1426785618,180577780],[1426801164,221107329],[1426816819,202646985],[1426831567,237950304],[1426846521,169784945],[1426861395,72449002],[1426875350,187551076],[1426890674,110449365],[1426904214,435946183],[1426918179,101202892],[1426933140,232436803],[1426947827,245575793],[1426963376,210895388],[1426977075,124719312],[1426990778,163514112],[1427006251,73040567],[1427021770,158870664],[1427035519,163143061],[1427049944,266463965],[1427064593,107973630],[1427078959,132594319],[1427092273,299709512],[1427105203,348305748],[1427120019,76748225],[1427135774,41141662],[1427149066,87486931],[1427162670,127828751],[1427176614,72630626],[1427190220,78923620],[1427203964,139744211],[1427219308,121578643],[1427233324,127573071],[1427246775,111461261],[1427261934,100564123],[1427277738,331363968],[1427293184,83007553],[1427295684,96023870],[1427298464,37337435],[1427314269,236792538],[1427329440,130503733],[1427345090,132808228],[1427349242,156931710],[1427350378,100443810],[1427365577,24031432]],"loss_dst":[[1420156800,6.94700937035781e-06],[1420243200,4.63555283603122e-06],[1420329600,5.77171926819217e-06],[1420416000,3.47033843897236e-06],[1420502400,2.42791688199977e-05],[1420588800,0.000130033425556444],[1420675200,4.27497567885458e-05],[1420761600,8.33260037311533e-05],[1420848000,4.40249459246223e-05],[1420934400,1.38878119405092e-05],[1421020800,3.24158490347602e-05],[1421107200,6.12072141363258e-05],[1421193600,9.7249798843422e-05],[1421280000,7.28940560104042e-05],[1421366400,7.76512693085096e-05],[1421452800,4.28210508285873e-05],[1421539200,1.04053099452796e-05],[1421625600,9.2653932927818e-06],[1421712000,8.57032998086732e-05],[1421798400,9.02012528722739e-05],[1421884800,0.000124833699550714],[1421971200,5.78843724928831e-05],[1422057600,0.000149545278020902],[1422144000,1.50559851015237e-05],[1422230400,2.08798780615121e-05],[1422316800,2.66589085379211e-05],[1422403200,1.62343874475716e-05],[1422489600,1.04047205060856e-05],[1422576000,0.000302823832235597],[1422662400,9.27651314423934e-06],[1422748800,9.25400033083051e-06],[1422835200,7.05944165602928e-05],[1422921600,6.48796193420048e-05],[1423008000,3.93756869030675e-05],[1423094400,0.000588331046671162],[1423180800,0.000631188607045643],[1423267200,1.04111598379098e-05],[1423353600,1.61718840244889e-05],[1423440000,0.000250673976443609],[1423526400,0.000318104789501385],[1423612800,0.00012746160219234],[1423699200,0.000310054919055998],[1423785600,0.000594498627901802],[1423872000,9.2605668856019e-06],[1423958400,6.94152803856713e-06],[1424044800,2.08433931654514e-05],[1424131200,2.43474591107612e-05],[1424217600,4.51472494906464e-05],[1424304000,2.55039936935579e-05],[1424390400,7.63488587580817e-05],[1424476800,2.31614177103781e-06],[1424563200,0.00012529569203247],[1424649600,0.000309114000548764],[1424736000,2.31029850211797e-05],[1424822400,5.55500905582205e-05],[1424908800,5.21326904407182e-05],[1424995200,7.87745460906394e-05],[1425081600,8.09048397275125e-06],[1425168000,3.48274705156439e-06],[1425254400,1.85643277160772e-05],[1425340800,3.13674463994238e-05],[1425427200,2.5497343060956e-05],[1425513600,3.12814262476655e-05],[1425600000,2.77534934709907e-05],[1425686400,0.000111414276578978],[1425772800,6.95608622764488e-06],[1425859200,1.27941491192973e-05],[1425945600,0.000144534104803544],[1426032000,5.09379529425929e-05],[1426118400,0.000334921797498633],[1426204800,0.000514257916560495],[1426291200,0.000612720921866478],[1426377600,0.000311362524731827],[1426464000,4.17482787532572e-05],[1426550400,2.55685813272651e-05],[1426636800,2.32027713390087e-05],[1426723200,5.78237900950161e-05],[1426809600,6.95150859322321e-05],[1426896000,8.11429565015794e-06],[1426982400,7.03178013029889e-06],[1427068800,0.000497876597898699],[1427155200,0.000626168993734831],[1427241600,0.000255196542498456],[1427328000,0.000356834979720468]],"error_tool_src":[[1420921430,"bwctl/tracepath,traceroute"],[1421193308,"bwctl/tracepath,traceroute"],[1421332399,"bwctl/tracepath,traceroute"],[1421571686,"bwctl/tracepath,traceroute"],[1421698449,"bwctl/tracepath,traceroute"],[1421972297,"bwctl/tracepath,traceroute"],[1422536331,"bwctl/tracepath,traceroute"],[1422707358,"bwctl/tracepath,traceroute"],[1423043009,"bwctl/tracepath,traceroute"],[1423740435,"bwctl/tracepath,traceroute"],[1424628835,"bwctl/tracepath,traceroute"],[1424744363,"bwctl/tracepath,traceroute"],[1425519825,"bwctl/tracepath,traceroute"],[1425643957,"bwctl/tracepath,traceroute"],[1426277627,"bwctl/tracepath,traceroute"],[1420284353,"bwctl/iperf"],[1420298085,"bwctl/iperf"],[1420313552,"bwctl/iperf"],[1420328754,"bwctl/iperf"],[1420343585,"bwctl/iperf"],[1420358350,"bwctl/iperf"],[1420372035,"bwctl/iperf"],[1420386347,"bwctl/iperf"],[1420401102,"bwctl/iperf"],[1420572694,"bwctl/iperf"],[1420587405,"bwctl/iperf"],[1420602143,"bwctl/iperf"],[1420617207,"bwctl/iperf"],[1420632240,"bwctl/iperf"],[1420646516,"bwctl/iperf"],[1420662137,"bwctl/iperf"],[1420676450,"bwctl/iperf"],[1420691316,"bwctl/iperf"],[1420851139,"bwctl/iperf"],[1420866329,"bwctl/iperf"],[1420881345,"bwctl/iperf"],[1420894511,"bwctl/iperf"],[1420907562,"bwctl/iperf"],[1420922163,"bwctl/iperf"],[1421052768,"bwctl/iperf"],[1421068366,"bwctl/iperf"],[1421083265,"bwctl/iperf"],[1421097349,"bwctl/iperf"],[1421112729,"bwctl/iperf"],[1421126101,"bwctl/iperf"],[1421255996,"bwctl/iperf"],[1421269459,"bwctl/iperf"],[1421284739,"bwctl/iperf"],[1421297849,"bwctl/iperf"],[1421313543,"bwctl/iperf"],[1421327997,"bwctl/iperf"],[1421341314,"bwctl/iperf"],[1421458106,"bwctl/iperf"],[1421473804,"bwctl/iperf"],[1421487979,"bwctl/iperf"],[1421502874,"bwctl/iperf"],[1421518329,"bwctl/iperf"],[1421531565,"bwctl/iperf"],[1421544703,"bwctl/iperf"],[1421676048,"bwctl/iperf"],[1421689760,"bwctl/iperf"],[1421702800,"bwctl/iperf"],[1421717192,"bwctl/iperf"],[1421730344,"bwctl/iperf"],[1421743534,"bwctl/iperf"],[1421871881,"bwctl/iperf"],[1421884976,"bwctl/iperf"],[1421900345,"bwctl/iperf"],[1421915775,"bwctl/iperf"],[1421930086,"bwctl/iperf"],[1421944511,"bwctl/iperf"],[1422074181,"bwctl/iperf"],[1422087202,"bwctl/iperf"],[1422103031,"bwctl/iperf"],[1422118728,"bwctl/iperf"],[1422126583,"bwctl/iperf"],[1422142153,"bwctl/iperf"],[1422155120,"bwctl/iperf"],[1422314441,"bwctl/iperf"],[1422329919,"bwctl/iperf"],[1422344717,"bwctl/iperf"],[1422360169,"bwctl/iperf"],[1422375462,"bwctl/iperf"],[1422511431,"bwctl/iperf"],[1422525633,"bwctl/iperf"],[1422540666,"bwctl/iperf"],[1422555014,"bwctl/iperf"],[1422568075,"bwctl/iperf"],[1422581228,"bwctl/iperf"],[1422687888,"bwctl/iperf"],[1422701529,"bwctl/iperf"],[1422714982,"bwctl/iperf"],[1422730683,"bwctl/iperf"],[1422744084,"bwctl/iperf"],[1422757572,"bwctl/iperf"],[1422773156,"bwctl/iperf"],[1422787526,"bwctl/iperf"],[1422904288,"bwctl/iperf"],[1422917405,"bwctl/iperf"],[1422933178,"bwctl/iperf"],[1422948291,"bwctl/iperf"],[1422963536,"bwctl/iperf"],[1422979237,"bwctl/iperf"],[1422992860,"bwctl/iperf"],[1423108179,"bwctl/iperf"],[1423121150,"bwctl/iperf"],[1423134990,"bwctl/iperf"],[1423148508,"bwctl/iperf"],[1423162047,"bwctl/iperf"],[1423177066,"bwctl/iperf"],[1423192732,"bwctl/iperf"],[1423292994,"bwctl/iperf"],[1423308336,"bwctl/iperf"],[1423322844,"bwctl/iperf"],[1423338077,"bwctl/iperf"],[1423353604,"bwctl/iperf"],[1423368967,"bwctl/iperf"],[1423482252,"bwctl/iperf"],[1423496309,"bwctl/iperf"],[1423510824,"bwctl/iperf"],[1423517517,"bwctl/iperf"],[1423533111,"bwctl/iperf"],[1423546573,"bwctl/iperf"],[1423657303,"bwctl/iperf"],[1423672685,"bwctl/iperf"],[1423686313,"bwctl/iperf"],[1423700367,"bwctl/iperf"],[1423714799,"bwctl/iperf"],[1423730309,"bwctl/iperf"],[1423844053,"bwctl/iperf"],[1423858619,"bwctl/iperf"],[1423873190,"bwctl/iperf"],[1423887765,"bwctl/iperf"],[1423903014,"bwctl/iperf"],[1424016307,"bwctl/iperf"],[1424031955,"bwctl/iperf"],[1424046309,"bwctl/iperf"],[1424060754,"bwctl/iperf"],[1424076516,"bwctl/iperf"],[1424091788,"bwctl/iperf"],[1424193410,"bwctl/iperf"],[1424207658,"bwctl/iperf"],[1424222767,"bwctl/iperf"],[1424238066,"bwctl/iperf"],[1424252253,"bwctl/iperf"],[1424266262,"bwctl/iperf"],[1424382075,"bwctl/iperf"],[1424397540,"bwctl/iperf"],[1424411471,"bwctl/iperf"],[1424426592,"bwctl/iperf"],[1424440118,"bwctl/iperf"],[1424554308,"bwctl/iperf"],[1424569942,"bwctl/iperf"],[1424584768,"bwctl/iperf"],[1424600166,"bwctl/iperf"],[1424613822,"bwctl/iperf"],[1424628457,"bwctl/iperf"],[1424742352,"bwctl/iperf"],[1424757081,"bwctl/iperf"],[1424770169,"bwctl/iperf"],[1424785104,"bwctl/iperf"],[1424799077,"bwctl/iperf"],[1424912017,"bwctl/iperf"],[1424926497,"bwctl/iperf"],[1424940446,"bwctl/iperf"],[1424955947,"bwctl/iperf"],[1424970723,"bwctl/iperf"],[1424986442,"bwctl/iperf"],[1425102538,"bwctl/iperf"],[1425117014,"bwctl/iperf"],[1425130274,"bwctl/iperf"],[1425144891,"bwctl/iperf"],[1425158478,"bwctl/iperf"],[1425272015,"bwctl/iperf"],[1425286058,"bwctl/iperf"],[1425300481,"bwctl/iperf"],[1425315995,"bwctl/iperf"],[1425331146,"bwctl/iperf"],[1425344203,"bwctl/iperf"],[1425458523,"bwctl/iperf"],[1425474195,"bwctl/iperf"],[1425489364,"bwctl/iperf"],[1425503071,"bwctl/iperf"],[1425516436,"bwctl/iperf"],[1425618660,"bwctl/iperf"],[1425633205,"bwctl/iperf"],[1425648230,"bwctl/iperf"],[1425663076,"bwctl/iperf"],[1425677246,"bwctl/iperf"],[1425692729,"bwctl/iperf"],[1425708493,"bwctl/iperf"],[1426006954,"bwctl/iperf"],[1426020967,"bwctl/iperf"],[1426035237,"bwctl/iperf"],[1426049254,"bwctl/iperf"],[1426064946,"bwctl/iperf"],[1426079463,"bwctl/iperf"],[1426168305,"bwctl/iperf"],[1426183510,"bwctl/iperf"],[1426198521,"bwctl/iperf"],[1426211823,"bwctl/iperf"],[1426226827,"bwctl/iperf"],[1426240377,"bwctl/iperf"],[1426256011,"bwctl/iperf"],[1426360806,"bwctl/iperf"],[1426376356,"bwctl/iperf"],[1426390279,"bwctl/iperf"],[1426403707,"bwctl/iperf"],[1426418873,"bwctl/iperf"],[1426432884,"bwctl/iperf"],[1426538947,"bwctl/iperf"],[1426540622,"bwctl/iperf"],[1426554416,"bwctl/iperf"],[1426569075,"bwctl/iperf"],[1426583748,"bwctl/iperf"],[1426597003,"bwctl/iperf"],[1426603220,"bwctl/iperf"],[1426713874,"bwctl/iperf"],[1426727079,"bwctl/iperf"],[1426740773,"bwctl/iperf"],[1426756418,"bwctl/iperf"],[1426770995,"bwctl/iperf"],[1426784809,"bwctl/iperf"],[1426905964,"bwctl/iperf"],[1426920046,"bwctl/iperf"],[1426933562,"bwctl/iperf"],[1426948902,"bwctl/iperf"],[1426963894,"bwctl/iperf"],[1427081862,"bwctl/iperf"],[1427094841,"bwctl/iperf"],[1427109024,"bwctl/iperf"],[1427122762,"bwctl/iperf"],[1427136682,"bwctl/iperf"],[1427151047,"bwctl/iperf"],[1427265837,"bwctl/iperf"],[1427280904,"bwctl/iperf"],[1427294149,"bwctl/iperf"],[1427297974,"bwctl/iperf"],[1427313195,"bwctl/iperf"],[1427326332,"bwctl/iperf"]],"owdelay_median_dst":[[1420156800,27],[1420243200,27],[1420329600,26.9],[1420416000,27],[1420502400,27],[1420588800,27],[1420675200,27],[1420761600,27],[1420848000,27],[1420934400,27],[1421020800,27],[1421107200,27],[1421193600,27],[1421280000,27],[1421366400,27],[1421452800,27],[1421539200,27],[1421625600,27],[1421712000,27.2],[1421798400,27],[1421884800,27.6],[1421971200,27.5],[1422057600,27.5],[1422144000,27.9],[1422230400,28.7],[1422316800,27.4],[1422403200,27.5],[1422489600,27.4],[1422576000,27.4],[1422662400,27.4],[1422748800,27.4],[1422835200,27.4],[1422921600,27.4],[1423008000,27.4],[1423094400,27.3],[1423180800,27.4],[1423267200,27.3],[1423353600,27.3],[1423440000,27.4],[1423526400,27.4],[1423612800,27.4],[1423699200,27.6],[1423785600,27.4],[1423872000,27.4],[1423958400,27.4],[1424044800,27.4],[1424131200,27.3],[1424217600,26.8],[1424304000,26.8],[1424390400,26.8],[1424476800,26.8],[1424563200,26.8],[1424649600,26.7],[1424736000,26.7],[1424822400,27.7],[1424908800,27.7],[1424995200,27.6],[1425081600,27.7],[1425168000,27.7],[1425254400,27.6],[1425340800,27.7],[1425427200,27.7],[1425513600,27.7],[1425600000,27.4],[1425686400,27.3],[1425772800,105.5],[1425859200,157.2],[1425945600,27.2],[1426032000,27.2],[1426118400,27.2],[1426204800,27.2],[1426291200,27.3],[1426377600,27.3],[1426464000,27.2],[1426550400,27.2],[1426636800,27.2],[1426723200,27.2],[1426809600,27.2],[1426896000,27.2],[1426982400,27.2],[1427068800,27.2],[1427155200,27.2],[1427241600,27.3],[1427328000,27.2]],"owdelay_minimum_src":[[1420156800,23.1],[1420243200,23.1],[1420329600,23],[1420416000,22.2],[1420502400,23],[1420588800,22.9],[1420675200,23.1],[1420761600,23.1],[1420848000,23.1],[1420934400,23.1],[1421020800,23],[1421107200,22.9],[1421193600,22.4],[1421280000,23.1],[1421366400,20.9],[1421452800,23.2],[1421539200,23.1],[1421625600,22.7],[1421712000,22.8],[1421798400,23],[1421884800,22.5],[1421971200,19.5],[1422057600,18.7],[1422144000,21.1],[1422230400,20],[1422316800,19.7],[1422403200,-8.6],[1422489600,19.7],[1422576000,19.4],[1422662400,18.8],[1422748800,19.8],[1422835200,22.2],[1422921600,18.1],[1423008000,21.6],[1423094400,21.4],[1423180800,21.6],[1423267200,22.3],[1423353600,22.1],[1423440000,22.1],[1423526400,22.1],[1423612800,21.5],[1423699200,21.9],[1423785600,22.2],[1423872000,22.2],[1423958400,21.8],[1424044800,22.1],[1424131200,21.8],[1424217600,21.2],[1424304000,22.8],[1424390400,22.9],[1424476800,17],[1424563200,20.8],[1424649600,20.5],[1424736000,22.9],[1424822400,23.8],[1424908800,23.1],[1424995200,23.9],[1425081600,23.8],[1425168000,23.8],[1425254400,23.5],[1425340800,17.7],[1425427200,23.8],[1425513600,23.8],[1425600000,23.7],[1425686400,-7],[1425772800,-101],[1425859200,-153.4],[1425945600,23.7],[1426032000,23.8],[1426118400,23.8],[1426204800,23.8],[1426291200,23.8],[1426377600,23.6],[1426464000,23.6],[1426550400,16.4],[1426636800,23.2],[1426723200,23.8],[1426809600,23.6],[1426896000,21],[1426982400,23.8],[1427068800,23.2],[1427155200,23.9],[1427241600,23.4],[1427328000,23.8]],"loss_src":[[1420156800,3.46860908775581e-06],[1420243200,1.73973556019485e-05],[1420329600,1.96964430541073e-05],[1420416000,2.54983773759852e-05],[1420502400,7.770818835537e-05],[1420588800,3.70756575136137e-05],[1420675200,1.6231884057971e-05],[1420761600,2.31561884913743e-05],[1420848000,2.90157845868152e-05],[1420934400,1.39421401185082e-05],[1421020800,4.63768115942029e-06],[1421107200,1.04311543810848e-05],[1421193600,4.63123769827486e-06],[1421280000,3.2463768115942e-05],[1421366400,4.51075641915337e-05],[1421452800,1.50410737012611e-05],[1421539200,1.85442744552619e-05],[1421625600,9.25604535462224e-06],[1421712000,3.00925925925926e-05],[1421798400,2.6657394529439e-05],[1421884800,3.7037037037037e-05],[1421971200,9.26569376882094e-05],[1422057600,0.000139082058414465],[1422144000,2.20213259156236e-05],[1422230400,9.85850150777082e-05],[1422316800,4.87125956854558e-05],[1422403200,7.30688935281837e-05],[1422489600,3.36465947325676e-05],[1422576000,0.000323782902399255],[1422662400,1.27403289321288e-05],[1422748800,9.25925925925926e-06],[1422835200,0.000114503816793893],[1422921600,3.01764159702878e-05],[1423008000,1.15740740740741e-05],[1423094400,0.000403441460295314],[1423180800,7.18907260963336e-06],[1423267200,2.66666666666667e-05],[1423353600,4.63123769827486e-06],[1423440000,0.000118219749652295],[1423526400,0.000894450237515931],[1423612800,0.000261755848969192],[1423699200,0.000499826449149601],[1423785600,0.000756049554243372],[1423872000,0.00293143386611073],[1423958400,0.00167014613778706],[1424044800,1.27314814814815e-05],[1424131200,3.35998146217124e-05],[1424217600,0.000784722222222222],[1424304000,0.00250666666666667],[1424390400,0.00120115942028986],[1424476800,0.000670604586518416],[1424563200,3.82342718109141e-05],[1424649600,4.52488687782805e-05],[1424736000,0.000329517863336802],[1424822400,0.00060437651962487],[1424908800,0.000705239920994539],[1424995200,0.00105439814814815],[1425081600,0.000727462582666203],[1425168000,1.85442744552619e-05],[1425254400,0.000282800185442745],[1425340800,0.000968789882817032],[1425427200,0.000657864257586287],[1425513600,0.000376660889659157],[1425600000,9.82431807674526e-05],[1425686400,0.000243874248728618],[1425772800,3.47342827370615e-06],[1425859200,0.000723325206083827],[1425945600,0.00127361791462561],[1426032000,0.00095536231884058],[1426118400,0.000626592541116516],[1426204800,0.000605744730136669],[1426291200,0.00087536231884058],[1426377600,0.00101262889584057],[1426464000,0.00112581244196843],[1426550400,0.000841480446927374],[1426636800,0.000369855072463768],[1426723200,0.000855324074074074],[1426809600,0.00106745479833102],[1426896000,0.00113080755416522],[1426982400,0.000870284971029916],[1427068800,0.000713521227256511],[1427155200,0.001244924005105],[1427241600,0.00115983026874116],[1427328000,0.00150914454277286]]}