perfSONAR User Q&A and Other Discussion

["Jack Wallis" <>]

Hi

We've recently installed the Perfsonar Centralized Management package on an
Ubuntu 18.04.2 LTS server, and are having an issue seeing the test results
sent by our perfsonar test-points to the Maddash server/Centralized
Measurement Archive.

In the dashboard is just shows an orange box on the grid, when hovering over
it shows 'unable to find any tests with data within the given time range where
source is x.x.x.x and destination is y.y.y.y', as well as saying one issue is
effecting the entire grid, and that is apparently due to the configuration.
I've followed all the suggested troubleshooting steps:

-Checked logs under /var/log/maddash - no connection errors or incorrect paths
i can see in any of the logs.
-the psconfig Maddash agent is running - have restarted it a few times, the
grid displays the correct tests and test-points, but cannot report any data.
-measurement archive is running - can see data on the esmond web interface,
and it matches what i see when i debug pscheduler archiving on the testpoint.
-maddash is installed on the same host as the measurement archive, so no
firewall should be in the way
-hosts are downloading the psconfig file, and show the correct tasks when i
run psconfig pscheduler-tasks on each of them
-systemctl status psconfig-pscheduler-agent is running on all devices.
-hosts are able to reach the measurement archive, debugged pscheduler
archiving and could see the task results successfully archived.  Also could
match up UIDs with those seen in the esmond web interface.

I am admittedly a newbie with Maddash, but I cant see what could be causing
this issue.  I've checked the logs, however cannot see anything obvious that
could cause an issue.

Apologies for the long post, all the logs i've looked at are below, i cannot
see anything that jumps out at me as being wrong, and unsure what other
commands i can run that might shed a bit more light on the issue.

maddash-server.log shows no errors, only:
INFO 2019-03-07 00:00:00,004 oldestAllowedTime=1551312000
INFO 2019-03-07 12:00:00,003 oldestAllowedTime=1551355200
INFO 2019-03-08 00:00:00,004 oldestAllowedTime=1551398400
INFO 2019-03-08 12:00:00,004 oldestAllowedTime=1551441600

psconfig-maddash-agent.log shows:
2019/03/08 12:56:04 INFO pid=4450
prog=perfSONAR_PS::PSConfig::MaDDash::Agent::_run_handle_psconfig line=375
guid=165339ea-bc1c-4d73-95b7-fdfbc282088f config_src=remote
task_name=Dashboard 1 - throughput_task config_url=/etc/perfsonar/psconfig/
dashboard.json viz_type=ps-graphs grid_name=Dashboard 1 - Dashboard 1 -
throughput_task - Throughput check_type=ps-nagios-throughput msg=Grid added
2019/03/08 12:56:04 INFO pid=4450
prog=perfSONAR_PS::PSConfig::MaDDash::Agent::_save_maddash_yaml line=987
guid=165339ea-bc1c-4d73-95b7-fdfbc282088f maddash_yaml_file=/etc/maddash/
maddash-server/maddash.yaml msg=Successfully generated a new MaDDash
configuration
2019/03/08 12:56:04 INFO pid=4450 prog=main:: line=178 guid=165339ea-
bc1c-4d73-95b7-fdfbc282088f msg=Agent completed running
2019/03/08 12:56:04 INFO pid=4450 prog=main:: line=186 guid=165339ea-
bc1c-4d73-95b7-fdfbc282088f msg=Time until next record refresh is 3599 seconds
2019/03/08 13:56:04 INFO pid=4450 prog=main:: line=176 guid=65219298-a1b6-
4954-a2ad-a956cd5c8c43 msg=Running agent...
2019/03/08 13:56:04 INFO pid=4450
prog=perfSONAR_PS::PSConfig::MaDDash::Agent::_run_handle_psconfig line=375
guid=65219298-a1b6-4954-a2ad-a956cd5c8c43 task_name=Dashboard 1 - latency_task
config_src=remote config_url=/etc/perfsonar/psconfig/dashboard.json
check_type=ps-nagios-loss viz_type=ps-graphs grid_name=Dashboard 1 - Dashboard
1 - latency_task - Loss msg=Grid added
2019/03/08 13:56:04 INFO pid=4450
prog=perfSONAR_PS::PSConfig::MaDDash::Agent::_run_handle_psconfig line=375
guid=65219298-a1b6-4954-a2ad-a956cd5c8c43 task_name=Dashboard 1 -
throughput_task config_src=remote config_url=/etc/perfsonar/psconfig/
dashboard.json check_type=ps-nagios-throughput grid_name=Dashboard 1 -
Dashboard 1 - throughput_task - Throughput viz_type=ps-graphs msg=Grid added
2019/03/08 13:56:05 INFO pid=4450
prog=perfSONAR_PS::PSConfig::MaDDash::Agent::_save_maddash_yaml line=987
guid=65219298-a1b6-4954-a2ad-a956cd5c8c43 maddash_yaml_file=/etc/maddash/
maddash-server/maddash.yaml msg=Successfully generated a new MaDDash
configuration
2019/03/08 13:56:05 INFO pid=4450 prog=main:: line=178 guid=65219298-a1b6-
4954-a2ad-a956cd5c8c43 msg=Agent completed running
2019/03/08 13:56:05 INFO pid=4450 prog=main:: line=186 guid=65219298-a1b6-
4954-a2ad-a956cd5c8c43 msg=Time until next record refresh is 3599 seconds

***on testpoint***
psconfig pscheduler-tasks
{
   "tasks" : [
      {
         "schedule" : {
            "slip" : "PT4H",
            "repeat" : "PT4H",
            "sliprand" : true
         },
         "schema" : 1,
         "archives" : [
            {
               "archiver" : "esmond",
               "data" : {
                  "url" : "http://10.149.196.250/esmond/perfsonar/archive";,
                  "measurement-agent" : "10.149.196.2"
               }
            }
         ],
         "test" : {
            "type" : "throughput",
            "spec" : {
               "source" : "10.149.196.2",
               "schema" : 1,
               "duration" : "PT30S",
               "dest" : "10.149.196.14"
            }
         },
         "reference" : {
            "psconfig" : {
               "created-by" : {
                  "user-agent" : "psconfig-pscheduler-agent",
                  "uuid" : "8bc86ef3-aec5-45ee-b4ce-96bd478e42cc"
               }
            }
         }
      },
      {
         "test" : {
            "type" : "throughput",
            "spec" : {
               "schema" : 1,
               "source" : "10.149.196.2",
               "dest" : "10.149.196.10",
               "duration" : "PT30S"
            }
         },
         "reference" : {
            "psconfig" : {
               "created-by" : {
                  "user-agent" : "psconfig-pscheduler-agent",
                  "uuid" : "8bc86ef3-aec5-45ee-b4ce-96bd478e42cc"
               }
            }
         },
         "archives" : [
            {
               "archiver" : "esmond",
               "data" : {
                  "measurement-agent" : "10.149.196.2",
                  "url" : "http://10.149.196.250/esmond/perfsonar/archive";
               }
            }
         ],
         "schema" : 1,
         "schedule" : {
            "repeat" : "PT4H",
            "slip" : "PT4H",
            "sliprand" : true
         }
      },
      {
         "archives" : [
            {
               "data" : {
                  "url" : "http://10.149.196.250/esmond/perfsonar/archive";,
                  "measurement-agent" : "10.149.196.2"
               },
               "archiver" : "esmond"
            }
         ],
         "test" : {
            "type" : "latencybg",
            "spec" : {
               "packet-count" : 600,
               "schema" : 1,
               "source" : "10.149.196.2",
               "packet-interval" : 0.1,
               "dest" : "10.149.196.14"
            }
         },
         "reference" : {
            "psconfig" : {
               "created-by" : {
                  "user-agent" : "psconfig-pscheduler-agent",
                  "uuid" : "8bc86ef3-aec5-45ee-b4ce-96bd478e42cc"
               }
            }
         },
         "schedule" : {},
         "schema" : 1
      },
      {
         "schedule" : {},
         "schema" : 1,
         "archives" : [
            {
               "archiver" : "esmond",
               "data" : {
                  "measurement-agent" : "10.149.196.2",
                  "url" : "http://10.149.196.250/esmond/perfsonar/archive";
               }
            }
         ],
         "test" : {
            "spec" : {
               "source" : "10.149.196.2",
               "schema" : 1,
               "packet-count" : 600,
               "dest" : "10.149.196.10",
               "packet-interval" : 0.1
            },
            "type" : "latencybg"
         },
         "reference" : {
            "psconfig" : {
               "created-by" : {
                  "uuid" : "8bc86ef3-aec5-45ee-b4ce-96bd478e42cc",
                  "user-agent" : "psconfig-pscheduler-agent"
               }
            }
         }
      }
   ]
}

*psconfig-pscheduler-agent-tasks.log*
2019/03/08 16:24:26 INFO guid=13f91b6e-c2e1-4cb1-9bc6-b775f702a00f
task_name=throughput_task
config_url=https://10.149.196.250/psconfig/dashboard.json config_src=remote
task={"schema":1,"test":{"spec":{"dest":"10.149.196.10","schema":
1,"source":"10.149.196.2","duration":"PT30S"},"type":"throughput"},"reference":
{"psconfig":{"created-by":{"user-agent":"psconfig-pscheduler-
agent","uuid":"8bc86ef3-aec5-45ee-b4ce-96bd478e42cc"}}},"schedule":
{"repeat":"PT4H","sliprand":true,"slip":"PT4H"},"archives":
[{"archiver":"esmond","data":
{"url":"http://10.149.196.250/esmond/perfsonar/archive","measurement-
agent":"10.149.196.2"}}]}
2019/03/08 16:24:26 INFO guid=13f91b6e-c2e1-4cb1-9bc6-b775f702a00f
task_name=throughput_task
config_url=https://10.149.196.250/psconfig/dashboard.json config_src=remote
task={"schema":1,"test":{"type":"throughput","spec":
{"duration":"PT30S","source":"10.149.196.2","schema":
1,"dest":"10.149.196.14"}},"reference":{"psconfig":{"created-by":{"user-
agent":"psconfig-pscheduler-agent","uuid":"8bc86ef3-aec5-45ee-
b4ce-96bd478e42cc"}}},"schedule":
{"repeat":"PT4H","sliprand":true,"slip":"PT4H"},"archives":
[{"archiver":"esmond","data":
{"url":"http://10.149.196.250/esmond/perfsonar/archive","measurement-
agent":"10.149.196.2"}}]}


*pscheduler.log*
Mar  8 16:48:42 gci-pervsonar-probe1 archiver DEBUG    Got 1 rows
Mar  8 16:48:42 gci-pervsonar-probe1 archiver DEBUG    5823: Starting worker
Mar  8 16:48:42 gci-pervsonar-probe1 archiver DEBUG    5823: Thread running
Mar  8 16:48:42 gci-pervsonar-probe1 archiver DEBUG    5823: Task is
https://localhost/pscheduler/tasks/de352cbf-6dc1-44e2-92dd-5b305dcd95c0
Mar  8 16:48:42 gci-pervsonar-probe1 archiver DEBUG    5823: Run is
https://localhost/pscheduler/tasks/de352cbf-6dc1-44e2-92dd-5b305dcd95c0/runs/bad7f1e7-7075-4a7c-977e-9228487d57c3
Mar  8 16:48:42 gci-pervsonar-probe1 archiver DEBUG    5823: Archiving to
esmond: {'last-attempt': None, 'attempts': 0, 'result': {'reference':
{u'psconfig': {u'created-by': {u'uuid': u'8bc86ef3-aec5-45ee-
b4ce-96bd478e42cc', u'user-agent': u'psconfig-pscheduler-agent'}}},
'schedule': {'duration': 'P1D', 'start': '2019-03-08T16:48:42Z'}, 'tool':
{'version': u'1.0', 'name': u'powstream'}, 'participants': [u'10.149.196.2'],
'result': {u'max-clock-error': 0.08, u'packets-duplicated': 0, u'succeeded':
True, u'histogram-latency': {u'3.35': 8, u'3.30': 67, u'3.41': 2, u'3.40': 2,
u'3.32': 20, u'3.42': 3, u'3.31': 24, u'3.34': 7, u'3.44': 1, u'3.36': 2,
u'3.37': 8, u'3.23': 1, u'3.22': 1, u'3.25': 7, u'3.33': 10, u'3.27': 143,
u'3.26': 53, u'3.29': 88, u'3.28': 149, u'3.38': 3, u'3.39': 1}, u'histogram-
ttl': {u'253': 600}, u'packets-sent': 600, u'packets-reordered': 0, u'packets-
lost': 0, u'packets-received': 600, u'schema': 1}, 'test': {u'type':
u'latencybg', u'spec': {u'dest': u'10.149.196.10', u'source': u'10.149.196.2',
u'packet-interval': 0.1, u'packet-count': 600, u'schema': 1}}, 'id':
'bad7f1e7-7075-4a7c-977e-9228487d57c3'}, 'task-href':
'https://localhost/pscheduler/tasks/de352cbf-6dc1-44e2-92dd-5b305dcd95c0',
'run-href':
'https://localhost/pscheduler/tasks/de352cbf-6dc1-44e2-92dd-5b305dcd95c0/runs/bad7f1e7-7075-4a7c-977e-9228487d57c3',
'data': {u'url': u'http://10.149.196.250/esmond/perfsonar/archive',
u'measurement-agent': u'10.149.196.2'}}
Mar  8 16:48:42 gci-pervsonar-probe1 archiver DEBUG    Pool esmond: Got a
process
Mar  8 16:48:42 gci-pervsonar-probe1 archiver DEBUG    Waiting 15.0 for change
or notification
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG    Archiver
received: {u'last-attempt': None, u'attempts': 0, u'result': {u'reference':
{u'psconfig': {u'created-by': {u'uuid': u'8bc86ef3-aec5-45ee-
b4ce-96bd478e42cc', u'user-agent': u'psconfig-pscheduler-agent'}}},
u'schedule': {u'duration': u'P1D', u'start': u'2019-03-08T16:48:42Z'},
u'tool': {u'version': u'1.0', u'name': u'powstream'}, u'participants':
[u'10.149.196.2'], u'result': {u'max-clock-error': 0.08, u'packets-
duplicated': 0, u'succeeded': True, u'histogram-latency': {u'3.44': 1,
u'3.42': 3, u'3.41': 2, u'3.40': 2, u'3.31': 24, u'3.34': 7, u'3.38': 3,
u'3.36': 2, u'3.37': 8, u'3.23': 1, u'3.35': 8, u'3.32': 20, u'3.33': 10,
u'3.27': 143, u'3.26': 53, u'3.29': 88, u'3.28': 149, u'3.25': 7, u'3.22': 1,
u'3.30': 67, u'3.39': 1}, u'histogram-ttl': {u'253': 600}, u'packets-sent':
600, u'packets-reordered': 0, u'packets-lost': 0, u'packets-received': 600,
u'schema': 1}, u'test': {u'type': u'latencybg', u'spec': {u'dest':
u'10.149.196.10', u'source': u'10.149.196.2', u'packet-interval': 0.1,
u'packet-count': 600, u'schema': 1}}, u'id': u'bad7f1e7-7075-
4a7c-977e-9228487d57c3'}, u'task-href':
u'https://localhost/pscheduler/tasks/de352cbf-6dc1-44e2-92dd-5b305dcd95c0',
u'run-href':
u'https://localhost/pscheduler/tasks/de352cbf-6dc1-44e2-92dd-5b305dcd95c0/runs/bad7f1e7-7075-4a7c-977e-9228487d57c3',
u'data': {u'url': u'http://10.149.196.250/esmond/perfsonar/archive',
u'measurement-agent': u'10.149.196.2'}}
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG    Archiver
received: {u'last-attempt': None, u'attempts': 0, u'result': {u'reference':
{u'psconfig': {u'created-by': {u'uuid': u'8bc86ef3-aec5-45ee-
b4ce-96bd478e42cc', u'user-agent': u'psconfig-pscheduler-agent'}}},
u'schedule': {u'duration': u'P1D', u'start': u'2019-03-08T16:48:42Z'},
u'tool': {u'version': u'1.0', u'name': u'powstream'}, u'participants':
[u'10.149.196.2'], u'result': {u'max-clock-error': 0.08, u'packets-
duplicated': 0, u'succeeded': True, u'histogram-latency': {u'3.44': 1,
u'3.42': 3, u'3.41': 2, u'3.40': 2, u'3.31': 24, u'3.34': 7, u'3.38': 3,
u'3.36': 2, u'3.37': 8, u'3.23': 1, u'3.35': 8, u'3.32': 20, u'3.33': 10,
u'3.27': 143, u'3.26': 53, u'3.29': 88, u'3.28': 149, u'3.25': 7, u'3.22': 1,
u'3.30': 67, u'3.39': 1}, u'histogram-ttl': {u'253': 600}, u'packets-sent':
600, u'packets-reordered': 0, u'packets-lost': 0, u'packets-received': 600,
u'schema': 1}, u'test': {u'type': u'latencybg', u'spec': {u'dest':
u'10.149.196.10', u'source': u'10.149.196.2', u'packet-interval': 0.1,
u'packet-count': 600, u'schema': 1}}, u'id': u'bad7f1e7-7075-
4a7c-977e-9228487d57c3'}, u'task-href':
u'https://localhost/pscheduler/tasks/de352cbf-6dc1-44e2-92dd-5b305dcd95c0',
u'run-href':
u'https://localhost/pscheduler/tasks/de352cbf-6dc1-44e2-92dd-5b305dcd95c0/runs/bad7f1e7-7075-4a7c-977e-9228487d57c3',
u'data': {u'url': u'http://10.149.196.250/esmond/perfsonar/archive',
u'measurement-agent': u'10.149.196.2'}}
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG    No
metadata key found for
https://localhost/pscheduler/tasks/de352cbf-6dc1-44e2-92dd-5b305dcd95c0@http://10.149.196.250/esmond/perfsonar/archive
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG    No
metadata key found for
https://localhost/pscheduler/tasks/de352cbf-6dc1-44e2-92dd-5b305dcd95c0@http://10.149.196.250/esmond/perfsonar/archive
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG
fast_mode is False
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG
fast_mode is False
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG    No
metadata key, so posting to esmond
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG    No
metadata key, so posting to esmond
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG    Posting
metadata to http://10.149.196.250/esmond/perfsonar/archive/: {'time-duration':
86400.0, 'sample-size': 600, 'pscheduler-test-type': 'latencybg', 'source':
'10.149.196.2', 'measurement-agent': '10.149.196.2', 'input-destination':
u'10.149.196.10', 'destination': '10.149.196.10', 'event-types': [{'event-
type': 'failures'}, {'summaries': [{'summary-type': 'aggregation', 'summary-
window': 300, 'event-type': 'packet-count-sent'}, {'summary-type':
'aggregation', 'summary-window': 3600, 'event-type': 'packet-count-sent'},
{'summary-type': 'aggregation', 'summary-window': 86400, 'event-type':
'packet-count-sent'}], 'event-type': 'packet-count-sent'}, {'summaries':
[{'summary-type': 'aggregation', 'summary-window': 300, 'event-type':
'histogram-owdelay'}, {'summary-type': 'statistics', 'summary-window': 300,
'event-type': 'histogram-owdelay'}, {'summary-type': 'aggregation', 'summary-
window': 3600, 'event-type': 'histogram-owdelay'}, {'summary-type':
'statistics', 'summary-window': 0, 'event-type': 'histogram-owdelay'},
{'summary-type': 'statistics', 'summary-window': 3600, 'event-type':
'histogram-owdelay'}, {'summary-type': 'aggregation', 'summary-window': 86400,
'event-type': 'histogram-owdelay'}, {'summary-type': 'statistics', 'summary-
window': 86400, 'event-type': 'histogram-owdelay'}], 'event-type': 'histogram-
owdelay'}, {'event-type': 'histogram-ttl'}, {'event-type': 'packet-
duplicates'}, {'summaries': [{'summary-type': 'aggregation', 'summary-window':
300, 'event-type': 'packet-loss-rate'}, {'summary-type': 'aggregation',
'summary-window': 3600, 'event-type': 'packet-loss-rate'}, {'summary-type':
'aggregation', 'summary-window': 86400, 'event-type': 'packet-loss-rate'}],
'event-type': 'packet-loss-rate'}, {'summaries': [{'summary-type':
'aggregation', 'summary-window': 300, 'event-type': 'packet-count-lost'},
{'summary-type': 'aggregation', 'summary-window': 3600, 'event-type': 'packet-
count-lost'}, {'summary-type': 'aggregation', 'summary-window': 86400, 'event-
type': 'packet-count-lost'}], 'event-type': 'packet-count-lost'}, {'event-
type': 'packet-reorders'}, {'event-type': 'time-error-estimates'}, {'event-
type': 'pscheduler-run-href'}], 'subject-type': 'point-to-point', 'input-
source': u'10.149.196.2', u'pscheduler-reference-psconfig-created-by-uuid':
u'8bc86ef3-aec5-45ee-b4ce-96bd478e42cc', 'tool-name': u'pscheduler/powstream',
u'pscheduler-reference-psconfig-created-by-user-agent': u'psconfig-pscheduler-
agent', 'time-probe-interval': 0.1}
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG    Posting
metadata to http://10.149.196.250/esmond/perfsonar/archive/: {'time-duration':
86400.0, 'sample-size': 600, 'pscheduler-test-type': 'latencybg', 'source':
'10.149.196.2', 'measurement-agent': '10.149.196.2', 'input-destination':
u'10.149.196.10', 'destination': '10.149.196.10', 'event-types': [{'event-
type': 'failures'}, {'summaries': [{'summary-type': 'aggregation', 'summary-
window': 300, 'event-type': 'packet-count-sent'}, {'summary-type':
'aggregation', 'summary-window': 3600, 'event-type': 'packet-count-sent'},
{'summary-type': 'aggregation', 'summary-window': 86400, 'event-type':
'packet-count-sent'}], 'event-type': 'packet-count-sent'}, {'summaries':
[{'summary-type': 'aggregation', 'summary-window': 300, 'event-type':
'histogram-owdelay'}, {'summary-type': 'statistics', 'summary-window': 300,
'event-type': 'histogram-owdelay'}, {'summary-type': 'aggregation', 'summary-
window': 3600, 'event-type': 'histogram-owdelay'}, {'summary-type':
'statistics', 'summary-window': 0, 'event-type': 'histogram-owdelay'},
{'summary-type': 'statistics', 'summary-window': 3600, 'event-type':
'histogram-owdelay'}, {'summary-type': 'aggregation', 'summary-window': 86400,
'event-type': 'histogram-owdelay'}, {'summary-type': 'statistics', 'summary-
window': 86400, 'event-type': 'histogram-owdelay'}], 'event-type': 'histogram-
owdelay'}, {'event-type': 'histogram-ttl'}, {'event-type': 'packet-
duplicates'}, {'summaries': [{'summary-type': 'aggregation', 'summary-window':
300, 'event-type': 'packet-loss-rate'}, {'summary-type': 'aggregation',
'summary-window': 3600, 'event-type': 'packet-loss-rate'}, {'summary-type':
'aggregation', 'summary-window': 86400, 'event-type': 'packet-loss-rate'}],
'event-type': 'packet-loss-rate'}, {'summaries': [{'summary-type':
'aggregation', 'summary-window': 300, 'event-type': 'packet-count-lost'},
{'summary-type': 'aggregation', 'summary-window': 3600, 'event-type': 'packet-
count-lost'}, {'summary-type': 'aggregation', 'summary-window': 86400, 'event-
type': 'packet-count-lost'}], 'event-type': 'packet-count-lost'}, {'event-
type': 'packet-reorders'}, {'event-type': 'time-error-estimates'}, {'event-
type': 'pscheduler-run-href'}], 'subject-type': 'point-to-point', 'input-
source': u'10.149.196.2', u'pscheduler-reference-psconfig-created-by-uuid':
u'8bc86ef3-aec5-45ee-b4ce-96bd478e42cc', 'tool-name': u'pscheduler/powstream',
u'pscheduler-reference-psconfig-created-by-user-agent': u'psconfig-pscheduler-
agent', 'time-probe-interval': 0.1}
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG    Esmond
returned HTTP 201: {u'metadata-key': u'39f6af4d115b428280a1e0a1ef9a18a5',
u'sample-size': u'600', u'pscheduler-test-type': u'latencybg', u'time-
duration': u'86400.0', u'url':
u'http://10.149.196.250/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/',
u'measurement-agent': u'10.149.196.2', u'input-destination': u'10.149.196.10',
u'destination': u'10.149.196.10', u'uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/', u'event-types': [{u'time-updated': None,
u'summaries': [], u'base-uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/time-error-estimates/base', u'event-type':
u'time-error-estimates'}, {u'time-updated': None, u'summaries': [], u'base-
uri': u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/packet-
duplicates/base', u'event-type': u'packet-duplicates'}, {u'time-updated':
None, u'summaries': [], u'base-uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/pscheduler-run-href/base', u'event-type':
u'pscheduler-run-href'}, {u'time-updated': None, u'summaries': [], u'base-
uri': u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/histogram-
ttl/base', u'event-type': u'histogram-ttl'}, {u'time-updated': None,
u'summaries': [{u'summary-type': u'aggregation', u'summary-window': u'300',
u'uri': u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/packet-
count-sent/aggregations/300', u'time-updated': None}, {u'summary-type':
u'aggregation', u'summary-window': u'3600', u'uri': u'/esmond/perfsonar/
archive/39f6af4d115b428280a1e0a1ef9a18a5/packet-count-sent/aggregations/3600',
u'time-updated': None}, {u'summary-type': u'aggregation', u'summary-window':
u'86400', u'uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/packet-count-sent/aggregations/86400',
u'time-updated': None}], u'base-uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/packet-count-sent/base', u'event-type':
u'packet-count-sent'}, {u'time-updated': None, u'summaries': [], u'base-uri':
u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/packet-reorders/
base', u'event-type': u'packet-reorders'}, {u'time-updated': None,
u'summaries': [{u'summary-type': u'aggregation', u'summary-window': u'300',
u'uri': u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/packet-
count-lost/aggregations/300', u'time-updated': None}, {u'summary-type':
u'aggregation', u'summary-window': u'3600', u'uri': u'/esmond/perfsonar/
archive/39f6af4d115b428280a1e0a1ef9a18a5/packet-count-lost/aggregations/3600',
u'time-updated': None}, {u'summary-type': u'aggregation', u'summary-window':
u'86400', u'uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/packet-count-lost/aggregations/86400',
u'time-updated': None}], u'base-uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/packet-count-lost/base', u'event-type':
u'packet-count-lost'}, {u'time-updated': None, u'summaries': [{u'summary-
type': u'aggregation', u'summary-window': u'300', u'uri': u'/esmond/perfsonar/
archive/39f6af4d115b428280a1e0a1ef9a18a5/histogram-owdelay/aggregations/300',
u'time-updated': None}, {u'summary-type': u'aggregation', u'summary-window':
u'3600', u'uri': u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/
histogram-owdelay/aggregations/3600', u'time-updated': None}, {u'summary-
type': u'aggregation', u'summary-window': u'86400', u'uri': u'/esmond/
perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/histogram-owdelay/
aggregations/86400', u'time-updated': None}, {u'summary-type': u'statistics',
u'summary-window': u'0', u'uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/histogram-owdelay/statistics/0', u'time-
updated': None}, {u'summary-type': u'statistics', u'summary-window': u'300',
u'uri': u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/
histogram-owdelay/statistics/300', u'time-updated': None}, {u'summary-type':
u'statistics', u'summary-window': u'3600', u'uri': u'/esmond/perfsonar/
archive/39f6af4d115b428280a1e0a1ef9a18a5/histogram-owdelay/statistics/3600',
u'time-updated': None}, {u'summary-type': u'statistics', u'summary-window':
u'86400', u'uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/histogram-owdelay/statistics/86400', u'time-
updated': None}], u'base-uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/histogram-owdelay/base', u'event-type':
u'histogram-owdelay'}, {u'time-updated': None, u'summaries': [], u'base-uri':
u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/failures/base',
u'event-type': u'failures'}, {u'time-updated': None, u'summaries':
[{u'summary-type': u'aggregation', u'summary-window': u'300', u'uri': u'/
esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/packet-loss-rate/
aggregations/300', u'time-updated': None}, {u'summary-type': u'aggregation',
u'summary-window': u'3600', u'uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/packet-loss-rate/aggregations/3600', u'time-
updated': None}, {u'summary-type': u'aggregation', u'summary-window':
u'86400', u'uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/packet-loss-rate/aggregations/86400', u'time-
updated': None}], u'base-uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/packet-loss-rate/base', u'event-type':
u'packet-loss-rate'}], u'subject-type': u'point-to-point', u'source':
u'10.149.196.2', u'input-source': u'10.149.196.2', u'pscheduler-reference-
psconfig-created-by-uuid': u'8bc86ef3-aec5-45ee-b4ce-96bd478e42cc', u'tool-
name': u'pscheduler/powstream', u'pscheduler-reference-psconfig-created-by-
user-agent': u'psconfig-pscheduler-agent', u'time-probe-interval': u'0.1'}
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG    Esmond
returned HTTP 201: {u'metadata-key': u'39f6af4d115b428280a1e0a1ef9a18a5',
u'sample-size': u'600', u'pscheduler-test-type': u'latencybg', u'time-
duration': u'86400.0', u'url':
u'http://10.149.196.250/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/',
u'measurement-agent': u'10.149.196.2', u'input-destination': u'10.149.196.10',
u'destination': u'10.149.196.10', u'uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/', u'event-types': [{u'time-updated': None,
u'summaries': [], u'base-uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/time-error-estimates/base', u'event-type':
u'time-error-estimates'}, {u'time-updated': None, u'summaries': [], u'base-
uri': u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/packet-
duplicates/base', u'event-type': u'packet-duplicates'}, {u'time-updated':
None, u'summaries': [], u'base-uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/pscheduler-run-href/base', u'event-type':
u'pscheduler-run-href'}, {u'time-updated': None, u'summaries': [], u'base-
uri': u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/histogram-
ttl/base', u'event-type': u'histogram-ttl'}, {u'time-updated': None,
u'summaries': [{u'summary-type': u'aggregation', u'summary-window': u'300',
u'uri': u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/packet-
count-sent/aggregations/300', u'time-updated': None}, {u'summary-type':
u'aggregation', u'summary-window': u'3600', u'uri': u'/esmond/perfsonar/
archive/39f6af4d115b428280a1e0a1ef9a18a5/packet-count-sent/aggregations/3600',
u'time-updated': None}, {u'summary-type': u'aggregation', u'summary-window':
u'86400', u'uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/packet-count-sent/aggregations/86400',
u'time-updated': None}], u'base-uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/packet-count-sent/base', u'event-type':
u'packet-count-sent'}, {u'time-updated': None, u'summaries': [], u'base-uri':
u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/packet-reorders/
base', u'event-type': u'packet-reorders'}, {u'time-updated': None,
u'summaries': [{u'summary-type': u'aggregation', u'summary-window': u'300',
u'uri': u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/packet-
count-lost/aggregations/300', u'time-updated': None}, {u'summary-type':
u'aggregation', u'summary-window': u'3600', u'uri': u'/esmond/perfsonar/
archive/39f6af4d115b428280a1e0a1ef9a18a5/packet-count-lost/aggregations/3600',
u'time-updated': None}, {u'summary-type': u'aggregation', u'summary-window':
u'86400', u'uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/packet-count-lost/aggregations/86400',
u'time-updated': None}], u'base-uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/packet-count-lost/base', u'event-type':
u'packet-count-lost'}, {u'time-updated': None, u'summaries': [{u'summary-
type': u'aggregation', u'summary-window': u'300', u'uri': u'/esmond/perfsonar/
archive/39f6af4d115b428280a1e0a1ef9a18a5/histogram-owdelay/aggregations/300',
u'time-updated': None}, {u'summary-type': u'aggregation', u'summary-window':
u'3600', u'uri': u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/
histogram-owdelay/aggregations/3600', u'time-updated': None}, {u'summary-
type': u'aggregation', u'summary-window': u'86400', u'uri': u'/esmond/
perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/histogram-owdelay/
aggregations/86400', u'time-updated': None}, {u'summary-type': u'statistics',
u'summary-window': u'0', u'uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/histogram-owdelay/statistics/0', u'time-
updated': None}, {u'summary-type': u'statistics', u'summary-window': u'300',
u'uri': u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/
histogram-owdelay/statistics/300', u'time-updated': None}, {u'summary-type':
u'statistics', u'summary-window': u'3600', u'uri': u'/esmond/perfsonar/
archive/39f6af4d115b428280a1e0a1ef9a18a5/histogram-owdelay/statistics/3600',
u'time-updated': None}, {u'summary-type': u'statistics', u'summary-window':
u'86400', u'uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/histogram-owdelay/statistics/86400', u'time-
updated': None}], u'base-uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/histogram-owdelay/base', u'event-type':
u'histogram-owdelay'}, {u'time-updated': None, u'summaries': [], u'base-uri':
u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/failures/base',
u'event-type': u'failures'}, {u'time-updated': None, u'summaries':
[{u'summary-type': u'aggregation', u'summary-window': u'300', u'uri': u'/
esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/packet-loss-rate/
aggregations/300', u'time-updated': None}, {u'summary-type': u'aggregation',
u'summary-window': u'3600', u'uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/packet-loss-rate/aggregations/3600', u'time-
updated': None}, {u'summary-type': u'aggregation', u'summary-window':
u'86400', u'uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/packet-loss-rate/aggregations/86400', u'time-
updated': None}], u'base-uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/packet-loss-rate/base', u'event-type':
u'packet-loss-rate'}], u'subject-type': u'point-to-point', u'source':
u'10.149.196.2', u'input-source': u'10.149.196.2', u'pscheduler-reference-
psconfig-created-by-uuid': u'8bc86ef3-aec5-45ee-b4ce-96bd478e42cc', u'tool-
name': u'pscheduler/powstream', u'pscheduler-reference-psconfig-created-by-
user-agent': u'psconfig-pscheduler-agent', u'time-probe-interval': u'0.1'}
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG    Added
metadata key 39f6af4d115b428280a1e0a1ef9a18a5 for task
https://localhost/pscheduler/tasks/de352cbf-6dc1-44e2-92dd-5b305dcd95c0@http://10.149.196.250/esmond/perfsonar/archive
to memcache
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG    Added
metadata key 39f6af4d115b428280a1e0a1ef9a18a5 for task
https://localhost/pscheduler/tasks/de352cbf-6dc1-44e2-92dd-5b305dcd95c0@http://10.149.196.250/esmond/perfsonar/archive
to memcache
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG    Putting
data to
http://10.149.196.250/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/:
{'data': [{'ts': 1552063722, 'val': [{'val': 0.08, 'event-type': 'time-error-
estimates'}, {'val': 0, 'event-type': 'packet-duplicates'}, {'val': {u'3.44':
1, u'3.42': 3, u'3.41': 2, u'3.40': 2, u'3.31': 24, u'3.34': 7, u'3.38': 3,
u'3.36': 2, u'3.37': 8, u'3.23': 1, u'3.35': 8, u'3.32': 20, u'3.33': 10,
u'3.27': 143, u'3.26': 53, u'3.29': 88, u'3.28': 149, u'3.25': 7, u'3.22': 1,
u'3.30': 67, u'3.39': 1}, 'event-type': 'histogram-owdelay'}, {'val': {u'253':
600}, 'event-type': 'histogram-ttl'}, {'val': 600, 'event-type': 'packet-
count-sent'}, {'val': 0, 'event-type': 'packet-reorders'}, {'val': 0, 'event-
type': 'packet-count-lost'}, {'val': {'denominator': 600, 'numerator': 0},
'event-type': 'packet-loss-rate'}, {'val': {'href':
'https://localhost/pscheduler/tasks/de352cbf-6dc1-44e2-92dd-5b305dcd95c0/runs/bad7f1e7-7075-4a7c-977e-9228487d57c3'},
'event-type': 'pscheduler-run-href'}]}]}
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG    Putting
data to
http://10.149.196.250/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/:
{'data': [{'ts': 1552063722, 'val': [{'val': 0.08, 'event-type': 'time-error-
estimates'}, {'val': 0, 'event-type': 'packet-duplicates'}, {'val': {u'3.44':
1, u'3.42': 3, u'3.41': 2, u'3.40': 2, u'3.31': 24, u'3.34': 7, u'3.38': 3,
u'3.36': 2, u'3.37': 8, u'3.23': 1, u'3.35': 8, u'3.32': 20, u'3.33': 10,
u'3.27': 143, u'3.26': 53, u'3.29': 88, u'3.28': 149, u'3.25': 7, u'3.22': 1,
u'3.30': 67, u'3.39': 1}, 'event-type': 'histogram-owdelay'}, {'val': {u'253':
600}, 'event-type': 'histogram-ttl'}, {'val': 600, 'event-type': 'packet-
count-sent'}, {'val': 0, 'event-type': 'packet-reorders'}, {'val': 0, 'event-
type': 'packet-count-lost'}, {'val': {'denominator': 600, 'numerator': 0},
'event-type': 'packet-loss-rate'}, {'val': {'href':
'https://localhost/pscheduler/tasks/de352cbf-6dc1-44e2-92dd-5b305dcd95c0/runs/bad7f1e7-7075-4a7c-977e-9228487d57c3'},
'event-type': 'pscheduler-run-href'}]}]}
Mar  8 16:48:43 gci-pervsonar-probe1 archiver DEBUG    5823: Returned JSON
from archiver: {u'succeeded': True}
Mar  8 16:48:43 gci-pervsonar-probe1 archiver DEBUG    5823: Succeeded:
bad7f1e7-7075-4a7c-977e-9228487d57c3 to esmond
Mar  8 16:48:43 gci-pervsonar-probe1 archiver DEBUG    5823: Thread finished

**output from Esmond web interface**
Mar  8 16:48:42 gci-pervsonar-probe1 archiver DEBUG    Got 1 rows
Mar  8 16:48:42 gci-pervsonar-probe1 archiver DEBUG    5823: Starting worker
Mar  8 16:48:42 gci-pervsonar-probe1 archiver DEBUG    5823: Thread running
Mar  8 16:48:42 gci-pervsonar-probe1 archiver DEBUG    5823: Task is
https://localhost/pscheduler/tasks/de352cbf-6dc1-44e2-92dd-5b305dcd95c0
Mar  8 16:48:42 gci-pervsonar-probe1 archiver DEBUG    5823: Run is
https://localhost/pscheduler/tasks/de352cbf-6dc1-44e2-92dd-5b305dcd95c0/runs/bad7f1e7-7075-4a7c-977e-9228487d57c3
Mar  8 16:48:42 gci-pervsonar-probe1 archiver DEBUG    5823: Archiving to
esmond: {'last-attempt': None, 'attempts': 0, 'result': {'reference':
{u'psconfig': {u'created-by': {u'uuid': u'8bc86ef3-aec5-45ee-
b4ce-96bd478e42cc', u'user-agent': u'psconfig-pscheduler-agent'}}},
'schedule': {'duration': 'P1D', 'start': '2019-03-08T16:48:42Z'}, 'tool':
{'version': u'1.0', 'name': u'powstream'}, 'participants': [u'10.149.196.2'],
'result': {u'max-clock-error': 0.08, u'packets-duplicated': 0, u'succeeded':
True, u'histogram-latency': {u'3.35': 8, u'3.30': 67, u'3.41': 2, u'3.40': 2,
u'3.32': 20, u'3.42': 3, u'3.31': 24, u'3.34': 7, u'3.44': 1, u'3.36': 2,
u'3.37': 8, u'3.23': 1, u'3.22': 1, u'3.25': 7, u'3.33': 10, u'3.27': 143,
u'3.26': 53, u'3.29': 88, u'3.28': 149, u'3.38': 3, u'3.39': 1}, u'histogram-
ttl': {u'253': 600}, u'packets-sent': 600, u'packets-reordered': 0, u'packets-
lost': 0, u'packets-received': 600, u'schema': 1}, 'test': {u'type':
u'latencybg', u'spec': {u'dest': u'10.149.196.10', u'source': u'10.149.196.2',
u'packet-interval': 0.1, u'packet-count': 600, u'schema': 1}}, 'id':
'bad7f1e7-7075-4a7c-977e-9228487d57c3'}, 'task-href':
'https://localhost/pscheduler/tasks/de352cbf-6dc1-44e2-92dd-5b305dcd95c0',
'run-href':
'https://localhost/pscheduler/tasks/de352cbf-6dc1-44e2-92dd-5b305dcd95c0/runs/bad7f1e7-7075-4a7c-977e-9228487d57c3',
'data': {u'url': u'http://10.149.196.250/esmond/perfsonar/archive',
u'measurement-agent': u'10.149.196.2'}}
Mar  8 16:48:42 gci-pervsonar-probe1 archiver DEBUG    Pool esmond: Got a
process
Mar  8 16:48:42 gci-pervsonar-probe1 archiver DEBUG    Waiting 15.0 for change
or notification
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG    Archiver
received: {u'last-attempt': None, u'attempts': 0, u'result': {u'reference':
{u'psconfig': {u'created-by': {u'uuid': u'8bc86ef3-aec5-45ee-
b4ce-96bd478e42cc', u'user-agent': u'psconfig-pscheduler-agent'}}},
u'schedule': {u'duration': u'P1D', u'start': u'2019-03-08T16:48:42Z'},
u'tool': {u'version': u'1.0', u'name': u'powstream'}, u'participants':
[u'10.149.196.2'], u'result': {u'max-clock-error': 0.08, u'packets-
duplicated': 0, u'succeeded': True, u'histogram-latency': {u'3.44': 1,
u'3.42': 3, u'3.41': 2, u'3.40': 2, u'3.31': 24, u'3.34': 7, u'3.38': 3,
u'3.36': 2, u'3.37': 8, u'3.23': 1, u'3.35': 8, u'3.32': 20, u'3.33': 10,
u'3.27': 143, u'3.26': 53, u'3.29': 88, u'3.28': 149, u'3.25': 7, u'3.22': 1,
u'3.30': 67, u'3.39': 1}, u'histogram-ttl': {u'253': 600}, u'packets-sent':
600, u'packets-reordered': 0, u'packets-lost': 0, u'packets-received': 600,
u'schema': 1}, u'test': {u'type': u'latencybg', u'spec': {u'dest':
u'10.149.196.10', u'source': u'10.149.196.2', u'packet-interval': 0.1,
u'packet-count': 600, u'schema': 1}}, u'id': u'bad7f1e7-7075-
4a7c-977e-9228487d57c3'}, u'task-href':
u'https://localhost/pscheduler/tasks/de352cbf-6dc1-44e2-92dd-5b305dcd95c0',
u'run-href':
u'https://localhost/pscheduler/tasks/de352cbf-6dc1-44e2-92dd-5b305dcd95c0/runs/bad7f1e7-7075-4a7c-977e-9228487d57c3',
u'data': {u'url': u'http://10.149.196.250/esmond/perfsonar/archive',
u'measurement-agent': u'10.149.196.2'}}
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG    Archiver
received: {u'last-attempt': None, u'attempts': 0, u'result': {u'reference':
{u'psconfig': {u'created-by': {u'uuid': u'8bc86ef3-aec5-45ee-
b4ce-96bd478e42cc', u'user-agent': u'psconfig-pscheduler-agent'}}},
u'schedule': {u'duration': u'P1D', u'start': u'2019-03-08T16:48:42Z'},
u'tool': {u'version': u'1.0', u'name': u'powstream'}, u'participants':
[u'10.149.196.2'], u'result': {u'max-clock-error': 0.08, u'packets-
duplicated': 0, u'succeeded': True, u'histogram-latency': {u'3.44': 1,
u'3.42': 3, u'3.41': 2, u'3.40': 2, u'3.31': 24, u'3.34': 7, u'3.38': 3,
u'3.36': 2, u'3.37': 8, u'3.23': 1, u'3.35': 8, u'3.32': 20, u'3.33': 10,
u'3.27': 143, u'3.26': 53, u'3.29': 88, u'3.28': 149, u'3.25': 7, u'3.22': 1,
u'3.30': 67, u'3.39': 1}, u'histogram-ttl': {u'253': 600}, u'packets-sent':
600, u'packets-reordered': 0, u'packets-lost': 0, u'packets-received': 600,
u'schema': 1}, u'test': {u'type': u'latencybg', u'spec': {u'dest':
u'10.149.196.10', u'source': u'10.149.196.2', u'packet-interval': 0.1,
u'packet-count': 600, u'schema': 1}}, u'id': u'bad7f1e7-7075-
4a7c-977e-9228487d57c3'}, u'task-href':
u'https://localhost/pscheduler/tasks/de352cbf-6dc1-44e2-92dd-5b305dcd95c0',
u'run-href':
u'https://localhost/pscheduler/tasks/de352cbf-6dc1-44e2-92dd-5b305dcd95c0/runs/bad7f1e7-7075-4a7c-977e-9228487d57c3',
u'data': {u'url': u'http://10.149.196.250/esmond/perfsonar/archive',
u'measurement-agent': u'10.149.196.2'}}
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG    No
metadata key found for
https://localhost/pscheduler/tasks/de352cbf-6dc1-44e2-92dd-5b305dcd95c0@http://10.149.196.250/esmond/perfsonar/archive
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG    No
metadata key found for
https://localhost/pscheduler/tasks/de352cbf-6dc1-44e2-92dd-5b305dcd95c0@http://10.149.196.250/esmond/perfsonar/archive
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG
fast_mode is False
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG
fast_mode is False
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG    No
metadata key, so posting to esmond
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG    No
metadata key, so posting to esmond
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG    Posting
metadata to http://10.149.196.250/esmond/perfsonar/archive/: {'time-duration':
86400.0, 'sample-size': 600, 'pscheduler-test-type': 'latencybg', 'source':
'10.149.196.2', 'measurement-agent': '10.149.196.2', 'input-destination':
u'10.149.196.10', 'destination': '10.149.196.10', 'event-types': [{'event-
type': 'failures'}, {'summaries': [{'summary-type': 'aggregation', 'summary-
window': 300, 'event-type': 'packet-count-sent'}, {'summary-type':
'aggregation', 'summary-window': 3600, 'event-type': 'packet-count-sent'},
{'summary-type': 'aggregation', 'summary-window': 86400, 'event-type':
'packet-count-sent'}], 'event-type': 'packet-count-sent'}, {'summaries':
[{'summary-type': 'aggregation', 'summary-window': 300, 'event-type':
'histogram-owdelay'}, {'summary-type': 'statistics', 'summary-window': 300,
'event-type': 'histogram-owdelay'}, {'summary-type': 'aggregation', 'summary-
window': 3600, 'event-type': 'histogram-owdelay'}, {'summary-type':
'statistics', 'summary-window': 0, 'event-type': 'histogram-owdelay'},
{'summary-type': 'statistics', 'summary-window': 3600, 'event-type':
'histogram-owdelay'}, {'summary-type': 'aggregation', 'summary-window': 86400,
'event-type': 'histogram-owdelay'}, {'summary-type': 'statistics', 'summary-
window': 86400, 'event-type': 'histogram-owdelay'}], 'event-type': 'histogram-
owdelay'}, {'event-type': 'histogram-ttl'}, {'event-type': 'packet-
duplicates'}, {'summaries': [{'summary-type': 'aggregation', 'summary-window':
300, 'event-type': 'packet-loss-rate'}, {'summary-type': 'aggregation',
'summary-window': 3600, 'event-type': 'packet-loss-rate'}, {'summary-type':
'aggregation', 'summary-window': 86400, 'event-type': 'packet-loss-rate'}],
'event-type': 'packet-loss-rate'}, {'summaries': [{'summary-type':
'aggregation', 'summary-window': 300, 'event-type': 'packet-count-lost'},
{'summary-type': 'aggregation', 'summary-window': 3600, 'event-type': 'packet-
count-lost'}, {'summary-type': 'aggregation', 'summary-window': 86400, 'event-
type': 'packet-count-lost'}], 'event-type': 'packet-count-lost'}, {'event-
type': 'packet-reorders'}, {'event-type': 'time-error-estimates'}, {'event-
type': 'pscheduler-run-href'}], 'subject-type': 'point-to-point', 'input-
source': u'10.149.196.2', u'pscheduler-reference-psconfig-created-by-uuid':
u'8bc86ef3-aec5-45ee-b4ce-96bd478e42cc', 'tool-name': u'pscheduler/powstream',
u'pscheduler-reference-psconfig-created-by-user-agent': u'psconfig-pscheduler-
agent', 'time-probe-interval': 0.1}
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG    Posting
metadata to http://10.149.196.250/esmond/perfsonar/archive/: {'time-duration':
86400.0, 'sample-size': 600, 'pscheduler-test-type': 'latencybg', 'source':
'10.149.196.2', 'measurement-agent': '10.149.196.2', 'input-destination':
u'10.149.196.10', 'destination': '10.149.196.10', 'event-types': [{'event-
type': 'failures'}, {'summaries': [{'summary-type': 'aggregation', 'summary-
window': 300, 'event-type': 'packet-count-sent'}, {'summary-type':
'aggregation', 'summary-window': 3600, 'event-type': 'packet-count-sent'},
{'summary-type': 'aggregation', 'summary-window': 86400, 'event-type':
'packet-count-sent'}], 'event-type': 'packet-count-sent'}, {'summaries':
[{'summary-type': 'aggregation', 'summary-window': 300, 'event-type':
'histogram-owdelay'}, {'summary-type': 'statistics', 'summary-window': 300,
'event-type': 'histogram-owdelay'}, {'summary-type': 'aggregation', 'summary-
window': 3600, 'event-type': 'histogram-owdelay'}, {'summary-type':
'statistics', 'summary-window': 0, 'event-type': 'histogram-owdelay'},
{'summary-type': 'statistics', 'summary-window': 3600, 'event-type':
'histogram-owdelay'}, {'summary-type': 'aggregation', 'summary-window': 86400,
'event-type': 'histogram-owdelay'}, {'summary-type': 'statistics', 'summary-
window': 86400, 'event-type': 'histogram-owdelay'}], 'event-type': 'histogram-
owdelay'}, {'event-type': 'histogram-ttl'}, {'event-type': 'packet-
duplicates'}, {'summaries': [{'summary-type': 'aggregation', 'summary-window':
300, 'event-type': 'packet-loss-rate'}, {'summary-type': 'aggregation',
'summary-window': 3600, 'event-type': 'packet-loss-rate'}, {'summary-type':
'aggregation', 'summary-window': 86400, 'event-type': 'packet-loss-rate'}],
'event-type': 'packet-loss-rate'}, {'summaries': [{'summary-type':
'aggregation', 'summary-window': 300, 'event-type': 'packet-count-lost'},
{'summary-type': 'aggregation', 'summary-window': 3600, 'event-type': 'packet-
count-lost'}, {'summary-type': 'aggregation', 'summary-window': 86400, 'event-
type': 'packet-count-lost'}], 'event-type': 'packet-count-lost'}, {'event-
type': 'packet-reorders'}, {'event-type': 'time-error-estimates'}, {'event-
type': 'pscheduler-run-href'}], 'subject-type': 'point-to-point', 'input-
source': u'10.149.196.2', u'pscheduler-reference-psconfig-created-by-uuid':
u'8bc86ef3-aec5-45ee-b4ce-96bd478e42cc', 'tool-name': u'pscheduler/powstream',
u'pscheduler-reference-psconfig-created-by-user-agent': u'psconfig-pscheduler-
agent', 'time-probe-interval': 0.1}
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG    Esmond
returned HTTP 201: {u'metadata-key': u'39f6af4d115b428280a1e0a1ef9a18a5',
u'sample-size': u'600', u'pscheduler-test-type': u'latencybg', u'time-
duration': u'86400.0', u'url':
u'http://10.149.196.250/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/',
u'measurement-agent': u'10.149.196.2', u'input-destination': u'10.149.196.10',
u'destination': u'10.149.196.10', u'uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/', u'event-types': [{u'time-updated': None,
u'summaries': [], u'base-uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/time-error-estimates/base', u'event-type':
u'time-error-estimates'}, {u'time-updated': None, u'summaries': [], u'base-
uri': u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/packet-
duplicates/base', u'event-type': u'packet-duplicates'}, {u'time-updated':
None, u'summaries': [], u'base-uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/pscheduler-run-href/base', u'event-type':
u'pscheduler-run-href'}, {u'time-updated': None, u'summaries': [], u'base-
uri': u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/histogram-
ttl/base', u'event-type': u'histogram-ttl'}, {u'time-updated': None,
u'summaries': [{u'summary-type': u'aggregation', u'summary-window': u'300',
u'uri': u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/packet-
count-sent/aggregations/300', u'time-updated': None}, {u'summary-type':
u'aggregation', u'summary-window': u'3600', u'uri': u'/esmond/perfsonar/
archive/39f6af4d115b428280a1e0a1ef9a18a5/packet-count-sent/aggregations/3600',
u'time-updated': None}, {u'summary-type': u'aggregation', u'summary-window':
u'86400', u'uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/packet-count-sent/aggregations/86400',
u'time-updated': None}], u'base-uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/packet-count-sent/base', u'event-type':
u'packet-count-sent'}, {u'time-updated': None, u'summaries': [], u'base-uri':
u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/packet-reorders/
base', u'event-type': u'packet-reorders'}, {u'time-updated': None,
u'summaries': [{u'summary-type': u'aggregation', u'summary-window': u'300',
u'uri': u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/packet-
count-lost/aggregations/300', u'time-updated': None}, {u'summary-type':
u'aggregation', u'summary-window': u'3600', u'uri': u'/esmond/perfsonar/
archive/39f6af4d115b428280a1e0a1ef9a18a5/packet-count-lost/aggregations/3600',
u'time-updated': None}, {u'summary-type': u'aggregation', u'summary-window':
u'86400', u'uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/packet-count-lost/aggregations/86400',
u'time-updated': None}], u'base-uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/packet-count-lost/base', u'event-type':
u'packet-count-lost'}, {u'time-updated': None, u'summaries': [{u'summary-
type': u'aggregation', u'summary-window': u'300', u'uri': u'/esmond/perfsonar/
archive/39f6af4d115b428280a1e0a1ef9a18a5/histogram-owdelay/aggregations/300',
u'time-updated': None}, {u'summary-type': u'aggregation', u'summary-window':
u'3600', u'uri': u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/
histogram-owdelay/aggregations/3600', u'time-updated': None}, {u'summary-
type': u'aggregation', u'summary-window': u'86400', u'uri': u'/esmond/
perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/histogram-owdelay/
aggregations/86400', u'time-updated': None}, {u'summary-type': u'statistics',
u'summary-window': u'0', u'uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/histogram-owdelay/statistics/0', u'time-
updated': None}, {u'summary-type': u'statistics', u'summary-window': u'300',
u'uri': u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/
histogram-owdelay/statistics/300', u'time-updated': None}, {u'summary-type':
u'statistics', u'summary-window': u'3600', u'uri': u'/esmond/perfsonar/
archive/39f6af4d115b428280a1e0a1ef9a18a5/histogram-owdelay/statistics/3600',
u'time-updated': None}, {u'summary-type': u'statistics', u'summary-window':
u'86400', u'uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/histogram-owdelay/statistics/86400', u'time-
updated': None}], u'base-uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/histogram-owdelay/base', u'event-type':
u'histogram-owdelay'}, {u'time-updated': None, u'summaries': [], u'base-uri':
u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/failures/base',
u'event-type': u'failures'}, {u'time-updated': None, u'summaries':
[{u'summary-type': u'aggregation', u'summary-window': u'300', u'uri': u'/
esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/packet-loss-rate/
aggregations/300', u'time-updated': None}, {u'summary-type': u'aggregation',
u'summary-window': u'3600', u'uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/packet-loss-rate/aggregations/3600', u'time-
updated': None}, {u'summary-type': u'aggregation', u'summary-window':
u'86400', u'uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/packet-loss-rate/aggregations/86400', u'time-
updated': None}], u'base-uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/packet-loss-rate/base', u'event-type':
u'packet-loss-rate'}], u'subject-type': u'point-to-point', u'source':
u'10.149.196.2', u'input-source': u'10.149.196.2', u'pscheduler-reference-
psconfig-created-by-uuid': u'8bc86ef3-aec5-45ee-b4ce-96bd478e42cc', u'tool-
name': u'pscheduler/powstream', u'pscheduler-reference-psconfig-created-by-
user-agent': u'psconfig-pscheduler-agent', u'time-probe-interval': u'0.1'}
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG    Esmond
returned HTTP 201: {u'metadata-key': u'39f6af4d115b428280a1e0a1ef9a18a5',
u'sample-size': u'600', u'pscheduler-test-type': u'latencybg', u'time-
duration': u'86400.0', u'url':
u'http://10.149.196.250/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/',
u'measurement-agent': u'10.149.196.2', u'input-destination': u'10.149.196.10',
u'destination': u'10.149.196.10', u'uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/', u'event-types': [{u'time-updated': None,
u'summaries': [], u'base-uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/time-error-estimates/base', u'event-type':
u'time-error-estimates'}, {u'time-updated': None, u'summaries': [], u'base-
uri': u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/packet-
duplicates/base', u'event-type': u'packet-duplicates'}, {u'time-updated':
None, u'summaries': [], u'base-uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/pscheduler-run-href/base', u'event-type':
u'pscheduler-run-href'}, {u'time-updated': None, u'summaries': [], u'base-
uri': u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/histogram-
ttl/base', u'event-type': u'histogram-ttl'}, {u'time-updated': None,
u'summaries': [{u'summary-type': u'aggregation', u'summary-window': u'300',
u'uri': u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/packet-
count-sent/aggregations/300', u'time-updated': None}, {u'summary-type':
u'aggregation', u'summary-window': u'3600', u'uri': u'/esmond/perfsonar/
archive/39f6af4d115b428280a1e0a1ef9a18a5/packet-count-sent/aggregations/3600',
u'time-updated': None}, {u'summary-type': u'aggregation', u'summary-window':
u'86400', u'uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/packet-count-sent/aggregations/86400',
u'time-updated': None}], u'base-uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/packet-count-sent/base', u'event-type':
u'packet-count-sent'}, {u'time-updated': None, u'summaries': [], u'base-uri':
u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/packet-reorders/
base', u'event-type': u'packet-reorders'}, {u'time-updated': None,
u'summaries': [{u'summary-type': u'aggregation', u'summary-window': u'300',
u'uri': u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/packet-
count-lost/aggregations/300', u'time-updated': None}, {u'summary-type':
u'aggregation', u'summary-window': u'3600', u'uri': u'/esmond/perfsonar/
archive/39f6af4d115b428280a1e0a1ef9a18a5/packet-count-lost/aggregations/3600',
u'time-updated': None}, {u'summary-type': u'aggregation', u'summary-window':
u'86400', u'uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/packet-count-lost/aggregations/86400',
u'time-updated': None}], u'base-uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/packet-count-lost/base', u'event-type':
u'packet-count-lost'}, {u'time-updated': None, u'summaries': [{u'summary-
type': u'aggregation', u'summary-window': u'300', u'uri': u'/esmond/perfsonar/
archive/39f6af4d115b428280a1e0a1ef9a18a5/histogram-owdelay/aggregations/300',
u'time-updated': None}, {u'summary-type': u'aggregation', u'summary-window':
u'3600', u'uri': u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/
histogram-owdelay/aggregations/3600', u'time-updated': None}, {u'summary-
type': u'aggregation', u'summary-window': u'86400', u'uri': u'/esmond/
perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/histogram-owdelay/
aggregations/86400', u'time-updated': None}, {u'summary-type': u'statistics',
u'summary-window': u'0', u'uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/histogram-owdelay/statistics/0', u'time-
updated': None}, {u'summary-type': u'statistics', u'summary-window': u'300',
u'uri': u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/
histogram-owdelay/statistics/300', u'time-updated': None}, {u'summary-type':
u'statistics', u'summary-window': u'3600', u'uri': u'/esmond/perfsonar/
archive/39f6af4d115b428280a1e0a1ef9a18a5/histogram-owdelay/statistics/3600',
u'time-updated': None}, {u'summary-type': u'statistics', u'summary-window':
u'86400', u'uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/histogram-owdelay/statistics/86400', u'time-
updated': None}], u'base-uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/histogram-owdelay/base', u'event-type':
u'histogram-owdelay'}, {u'time-updated': None, u'summaries': [], u'base-uri':
u'/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/failures/base',
u'event-type': u'failures'}, {u'time-updated': None, u'summaries':
[{u'summary-type': u'aggregation', u'summary-window': u'300', u'uri': u'/
esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/packet-loss-rate/
aggregations/300', u'time-updated': None}, {u'summary-type': u'aggregation',
u'summary-window': u'3600', u'uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/packet-loss-rate/aggregations/3600', u'time-
updated': None}, {u'summary-type': u'aggregation', u'summary-window':
u'86400', u'uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/packet-loss-rate/aggregations/86400', u'time-
updated': None}], u'base-uri': u'/esmond/perfsonar/archive/
39f6af4d115b428280a1e0a1ef9a18a5/packet-loss-rate/base', u'event-type':
u'packet-loss-rate'}], u'subject-type': u'point-to-point', u'source':
u'10.149.196.2', u'input-source': u'10.149.196.2', u'pscheduler-reference-
psconfig-created-by-uuid': u'8bc86ef3-aec5-45ee-b4ce-96bd478e42cc', u'tool-
name': u'pscheduler/powstream', u'pscheduler-reference-psconfig-created-by-
user-agent': u'psconfig-pscheduler-agent', u'time-probe-interval': u'0.1'}
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG    Added
metadata key 39f6af4d115b428280a1e0a1ef9a18a5 for task
https://localhost/pscheduler/tasks/de352cbf-6dc1-44e2-92dd-5b305dcd95c0@http://10.149.196.250/esmond/perfsonar/archive
to memcache
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG    Added
metadata key 39f6af4d115b428280a1e0a1ef9a18a5 for task
https://localhost/pscheduler/tasks/de352cbf-6dc1-44e2-92dd-5b305dcd95c0@http://10.149.196.250/esmond/perfsonar/archive
to memcache
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG    Putting
data to
http://10.149.196.250/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/:
{'data': [{'ts': 1552063722, 'val': [{'val': 0.08, 'event-type': 'time-error-
estimates'}, {'val': 0, 'event-type': 'packet-duplicates'}, {'val': {u'3.44':
1, u'3.42': 3, u'3.41': 2, u'3.40': 2, u'3.31': 24, u'3.34': 7, u'3.38': 3,
u'3.36': 2, u'3.37': 8, u'3.23': 1, u'3.35': 8, u'3.32': 20, u'3.33': 10,
u'3.27': 143, u'3.26': 53, u'3.29': 88, u'3.28': 149, u'3.25': 7, u'3.22': 1,
u'3.30': 67, u'3.39': 1}, 'event-type': 'histogram-owdelay'}, {'val': {u'253':
600}, 'event-type': 'histogram-ttl'}, {'val': 600, 'event-type': 'packet-
count-sent'}, {'val': 0, 'event-type': 'packet-reorders'}, {'val': 0, 'event-
type': 'packet-count-lost'}, {'val': {'denominator': 600, 'numerator': 0},
'event-type': 'packet-loss-rate'}, {'val': {'href':
'https://localhost/pscheduler/tasks/de352cbf-6dc1-44e2-92dd-5b305dcd95c0/runs/bad7f1e7-7075-4a7c-977e-9228487d57c3'},
'event-type': 'pscheduler-run-href'}]}]}
Mar  8 16:48:42 gci-pervsonar-probe1 archiver-esmond/archive DEBUG    Putting
data to
http://10.149.196.250/esmond/perfsonar/archive/39f6af4d115b428280a1e0a1ef9a18a5/:
{'data': [{'ts': 1552063722, 'val': [{'val': 0.08, 'event-type': 'time-error-
estimates'}, {'val': 0, 'event-type': 'packet-duplicates'}, {'val': {u'3.44':
1, u'3.42': 3, u'3.41': 2, u'3.40': 2, u'3.31': 24, u'3.34': 7, u'3.38': 3,
u'3.36': 2, u'3.37': 8, u'3.23': 1, u'3.35': 8, u'3.32': 20, u'3.33': 10,
u'3.27': 143, u'3.26': 53, u'3.29': 88, u'3.28': 149, u'3.25': 7, u'3.22': 1,
u'3.30': 67, u'3.39': 1}, 'event-type': 'histogram-owdelay'}, {'val': {u'253':
600}, 'event-type': 'histogram-ttl'}, {'val': 600, 'event-type': 'packet-
count-sent'}, {'val': 0, 'event-type': 'packet-reorders'}, {'val': 0, 'event-
type': 'packet-count-lost'}, {'val': {'denominator': 600, 'numerator': 0},
'event-type': 'packet-loss-rate'}, {'val': {'href':
'https://localhost/pscheduler/tasks/de352cbf-6dc1-44e2-92dd-5b305dcd95c0/runs/bad7f1e7-7075-4a7c-977e-9228487d57c3'},
'event-type': 'pscheduler-run-href'}]}]}
Mar  8 16:48:43 gci-pervsonar-probe1 archiver DEBUG    5823: Returned JSON
from archiver: {u'succeeded': True}
Mar  8 16:48:43 gci-pervsonar-probe1 archiver DEBUG    5823: Succeeded:
bad7f1e7-7075-4a7c-977e-9228487d57c3 to esmond
Mar  8 16:48:43 gci-pervsonar-probe1 archiver DEBUG    5823: Thread finished

Thanks
Jack
Core Network Specialist
GCI Networks